Apr 11 20:31:03 user nova-compute[71654]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 20:31:05 user nova-compute[71654]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71654) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 20:31:05 user nova-compute[71654]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71654) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 20:31:05 user nova-compute[71654]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71654) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 20:31:05 user nova-compute[71654]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 20:31:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:31:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:31:06 user nova-compute[71654]: INFO nova.virt.driver [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 20:31:06 user nova-compute[71654]: INFO nova.compute.provider_config [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Acquiring lock "singleton_lock" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Acquired lock "singleton_lock" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Releasing lock "singleton_lock" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Full set of CONF: {{(pid=71654) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ******************************************************************************** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Configuration options gathered from: {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ================================================================================ {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] allow_resize_to_same_host      = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] arq_binding_timeout            = 300 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] backdoor_port                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] backdoor_socket                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] block_device_allocate_retries  = 300 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] block_device_allocate_retries_interval = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cert                           = self.pem {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute_monitors               = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] config_dir                     = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] config_drive_format            = iso9660 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] config_source                  = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] console_host                   = user {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] control_exchange               = nova {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cpu_allocation_ratio           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] daemon                         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] debug                          = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] default_access_ip_network_name = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] default_availability_zone      = nova {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] default_ephemeral_format       = ext4 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] default_schedule_zone          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] disk_allocation_ratio          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] enable_new_services            = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] enabled_apis                   = ['osapi_compute'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] enabled_ssl_apis               = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] flat_injected                  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] force_config_drive             = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] force_raw_images               = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] graceful_shutdown_timeout      = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] heal_instance_info_cache_interval = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] host                           = user {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_build_timeout         = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_delete_interval       = 300 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_format                = [instance: %(uuid)s]  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_name_template         = instance-%08x {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_usage_audit           = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_usage_audit_period    = month {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] internal_service_availability_zone = internal {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] key                            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] live_migration_retry_count     = 30 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_config_append              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_dir                        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_file                       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_options                    = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_rotate_interval            = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_rotate_interval_type       = days {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] log_rotation_type              = none {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] long_rpc_timeout               = 1800 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] max_concurrent_builds          = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] max_concurrent_live_migrations = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] max_concurrent_snapshots       = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] max_local_block_devices        = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] max_logfile_count              = 30 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] max_logfile_size_mb            = 200 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] maximum_instance_delete_attempts = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metadata_listen                = 0.0.0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metadata_listen_port           = 8775 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metadata_workers               = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] migrate_max_retries            = -1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] mkisofs_cmd                    = genisoimage {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] my_ip                          = 10.0.0.210 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] network_allocate_retries       = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] osapi_compute_listen_port      = 8774 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] osapi_compute_unique_server_name_scope =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] osapi_compute_workers          = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] password_length                = 12 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] periodic_enable                = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] periodic_fuzzy_delay           = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] pointer_model                  = ps2mouse {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] preallocate_images             = none {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] publish_errors                 = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] pybasedir                      = /opt/stack/nova {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ram_allocation_ratio           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rate_limit_burst               = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rate_limit_except_level        = CRITICAL {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rate_limit_interval            = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reboot_timeout                 = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reclaim_instance_interval      = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] record                         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reimage_timeout_per_gb         = 20 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] report_interval                = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rescue_timeout                 = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reserved_host_cpus             = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reserved_host_disk_mb          = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reserved_host_memory_mb        = 512 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] reserved_huge_pages            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] resize_confirm_window          = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] resize_fs_using_block_device   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] resume_guests_state_on_host_boot = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rpc_response_timeout           = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] run_external_periodic_tasks    = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] running_deleted_instance_action = reap {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] running_deleted_instance_poll_interval = 1800 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] running_deleted_instance_timeout = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler_instance_sync_interval = 120 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_down_time              = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] servicegroup_driver            = db {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] shelved_offload_time           = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] shelved_poll_interval          = 3600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] shutdown_timeout               = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] source_is_ipv6                 = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ssl_only                       = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] state_path                     = /opt/stack/data/nova {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] sync_power_state_interval      = 600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] sync_power_state_pool_size     = 1000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] syslog_log_facility            = LOG_USER {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] tempdir                        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] timeout_nbd                    = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] transport_url                  = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] update_resources_interval      = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_cow_images                 = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_eventlog                   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_journal                    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_json                       = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_rootwrap_daemon            = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_stderr                     = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] use_syslog                     = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vcpu_pin_set                   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plugging_is_fatal          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plugging_timeout           = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] virt_mkfs                      = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] volume_usage_poll_interval     = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] watch_log_file                 = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] web                            = /usr/share/spice-html5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_concurrency.disable_process_locking = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.auth_strategy              = keystone {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.compute_link_prefix        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.dhcp_domain                = novalocal {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.enable_instance_password   = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.glance_link_prefix         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.instance_list_per_project_cells = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.list_records_by_skipping_down_cells = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.local_metadata_per_cell    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.max_limit                  = 1000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.metadata_cache_expiration  = 15 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.neutron_default_tenant_id  = default {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.use_forwarded_for          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.use_neutron_default_nets   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_dynamic_targets = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_jsonfile_path   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.backend                  = dogpile.cache.memcached {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.backend_argument         = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.config_prefix            = cache.oslo {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.dead_timeout             = 60.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.debug_cache_backend      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.enable_retry_client      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.enable_socket_keepalive  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.enabled                  = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.expiration_time          = 600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.hashclient_retry_attempts = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_dead_retry      = 300 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_password        =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_pool_maxsize    = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_sasl_enabled    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.memcache_username        =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.proxies                  = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.retry_attempts           = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.retry_delay              = 0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.socket_keepalive_count   = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.socket_keepalive_idle    = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.socket_keepalive_interval = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.tls_allowed_ciphers      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.tls_cafile               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.tls_certfile             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.tls_enabled              = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cache.tls_keyfile              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.auth_section            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.auth_type               = password {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.cafile                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.certfile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.collect_timing          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.cross_az_attach         = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.debug                   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.endpoint_template       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.http_retries            = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.insecure                = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.keyfile                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.os_region_name          = RegionOne {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.split_loggers           = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cinder.timeout                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.cpu_dedicated_set      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.cpu_shared_set         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.image_type_exclude_list = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.max_concurrent_disk_ops = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.max_disk_devices_to_attach = -1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.resource_provider_association_refresh = 300 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.shutdown_retry_interval = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] conductor.workers              = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] console.allowed_origins        = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] console.ssl_ciphers            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] console.ssl_minimum_version    = default {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] consoleauth.token_ttl          = 600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.cafile                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.certfile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.collect_timing          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.connect_retries         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.connect_retry_delay     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.endpoint_override       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.insecure                = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.keyfile                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.max_version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.min_version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.region_name             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.service_name            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.service_type            = accelerator {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.split_loggers           = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.status_code_retries     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.timeout                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] cyborg.version                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.backend               = sqlalchemy {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.connection            = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.connection_debug      = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.connection_parameters =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.connection_recycle_time = 3600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.connection_trace      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.db_inc_retry_interval = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.db_max_retries        = 20 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.db_max_retry_interval = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.db_retry_interval     = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.max_overflow          = 50 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.max_pool_size         = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.max_retries           = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.mysql_enable_ndb      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.mysql_wsrep_sync_wait = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.pool_timeout          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.retry_interval        = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.slave_connection      = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] database.sqlite_synchronous    = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.backend           = sqlalchemy {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.connection        = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.connection_debug  = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.connection_parameters =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.connection_recycle_time = 3600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.connection_trace  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.db_inc_retry_interval = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.db_max_retries    = 20 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.db_max_retry_interval = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.db_retry_interval = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.max_overflow      = 50 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.max_pool_size     = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.max_retries       = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.mysql_enable_ndb  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.pool_timeout      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.retry_interval    = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.slave_connection  = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] api_database.sqlite_synchronous = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] devices.enabled_mdev_types     = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ephemeral_storage_encryption.enabled = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.api_servers             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.cafile                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.certfile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.collect_timing          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.connect_retries         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.connect_retry_delay     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.debug                   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.default_trusted_certificate_ids = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.enable_certificate_validation = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.enable_rbd_download     = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.endpoint_override       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.insecure                = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.keyfile                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.max_version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.min_version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.num_retries             = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.rbd_ceph_conf           =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.rbd_connect_timeout     = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.rbd_pool                =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.rbd_user                =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.region_name             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.service_name            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.service_type            = image {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.split_loggers           = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.status_code_retries     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.timeout                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.verify_glance_signatures = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] glance.version                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] guestfs.debug                  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.config_drive_cdrom      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.config_drive_inject_password = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.enable_instance_metrics_collection = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.enable_remotefx         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.instances_path_share    =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.iscsi_initiator_list    = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.limit_cpu_features      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.power_state_check_timeframe = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.use_multipath_io        = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.volume_attach_retry_count = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.vswitch_name            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] mks.enabled                    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] image_cache.manager_interval   = 2400 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] image_cache.precache_concurrency = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] image_cache.remove_unused_base_images = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] image_cache.subdirectory_name  = _base {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.api_max_retries         = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.api_retry_interval      = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.auth_section            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.auth_type               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.cafile                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.certfile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.collect_timing          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.connect_retries         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.connect_retry_delay     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.endpoint_override       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.insecure                = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.keyfile                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.max_version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.min_version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.partition_key           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.peer_list               = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.region_name             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.serial_console_state_timeout = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.service_name            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.service_type            = baremetal {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.split_loggers           = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.status_code_retries     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.timeout                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ironic.version                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] key_manager.fixed_key          = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.barbican_api_version  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.barbican_endpoint     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.barbican_endpoint_type = public {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.barbican_region_name  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.cafile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.certfile              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.collect_timing        = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.insecure              = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.keyfile               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.number_of_retries     = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.retry_delay           = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.send_service_user_token = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.split_loggers         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.timeout               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.verify_ssl            = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican.verify_ssl_path       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.auth_section = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.auth_type = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.cafile   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.certfile = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.collect_timing = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.insecure = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.keyfile  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.split_loggers = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] barbican_service_user.timeout  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.approle_role_id          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.approle_secret_id        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.cafile                   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.certfile                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.collect_timing           = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.insecure                 = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.keyfile                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.kv_mountpoint            = secret {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.kv_version               = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.namespace                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.root_token_id            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.split_loggers            = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.ssl_ca_crt_file          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.timeout                  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.use_ssl                  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.cafile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.certfile              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.collect_timing        = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.connect_retries       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.connect_retry_delay   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.endpoint_override     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.insecure              = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.keyfile               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.max_version           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.min_version           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.region_name           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.service_name          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.service_type          = identity {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.split_loggers         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.status_code_retries   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.timeout               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] keystone.version               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.connection_uri         =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_mode               = custom {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: WARNING oslo_config.cfg [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_power_governor_high = performance {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_power_governor_low = powersave {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_power_management   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.device_detach_attempts = 8 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.device_detach_timeout  = 20 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.disk_cachemodes        = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.disk_prefix            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.enabled_perf_events    = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.file_backed_memory     = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.gid_maps               = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.hw_disk_discard        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.hw_machine_type        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_rbd_glance_store_name =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_rbd_pool        = rbd {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_type            = default {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.images_volume_group    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.inject_key             = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.inject_partition       = -2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.inject_password        = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.iscsi_iface            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.iser_use_multipath     = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_bandwidth = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_downtime = 500 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_inbound_addr = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_permit_post_copy = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_scheme  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_timeout_action = abort {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_tunnelled = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: WARNING oslo_config.cfg [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 20:31:06 user nova-compute[71654]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 20:31:06 user nova-compute[71654]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 20:31:06 user nova-compute[71654]: and ``live_migration_inbound_addr`` respectively.
Apr 11 20:31:06 user nova-compute[71654]: ).  Its value may be silently ignored in the future.
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.live_migration_with_native_tls = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.max_queues             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.nfs_mount_options      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.num_memory_encrypted_guests = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.num_pcie_ports         = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.pmem_namespaces        = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.quobyte_client_cfg     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rbd_secret_uuid        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rbd_user               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.remote_filesystem_transport = ssh {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rescue_image_id        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rescue_kernel_id       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rescue_ramdisk_id      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.rx_queue_size          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.smbfs_mount_options    =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.snapshot_compression   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.snapshot_image_format  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.sparse_logical_volumes = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.swtpm_enabled          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.swtpm_group            = tss {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.swtpm_user             = tss {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.sysinfo_serial         = unique {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.tx_queue_size          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.uid_maps               = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.use_virtio_for_bridges = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.virt_type              = kvm {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.volume_clear           = zero {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.volume_clear_size      = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.volume_use_multipath   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_cache_path   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.vzstorage_mount_user   = stack {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.auth_section           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.auth_type              = password {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.cafile                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.certfile               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.collect_timing         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.connect_retries        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.connect_retry_delay    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.default_floating_pool  = public {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.endpoint_override      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.extension_sync_interval = 600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.http_retries           = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.insecure               = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.keyfile                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.max_version            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.min_version            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.ovs_bridge             = br-int {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.physnets               = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.region_name            = RegionOne {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.service_metadata_proxy = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.service_name           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.service_type           = network {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.split_loggers          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.status_code_retries    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.timeout                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] neutron.version                = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] notifications.bdms_in_notifications = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] notifications.default_level    = INFO {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] notifications.notification_format = unversioned {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] notifications.notify_on_state_change = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] pci.alias                      = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] pci.device_spec                = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] pci.report_in_placement        = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.auth_section         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.auth_type            = password {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.cafile               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.certfile             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.collect_timing       = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.connect_retries      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.connect_retry_delay  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.default_domain_id    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.default_domain_name  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.domain_id            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.domain_name          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.endpoint_override    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.insecure             = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.keyfile              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.max_version          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.min_version          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.password             = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.project_domain_id    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.project_domain_name  = Default {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.project_id           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.project_name         = service {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.region_name          = RegionOne {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.service_name         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.service_type         = placement {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.split_loggers        = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.status_code_retries  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.system_scope         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.timeout              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.trust_id             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.user_domain_id       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.user_domain_name     = Default {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.user_id              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.username             = placement {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] placement.version              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.cores                    = 20 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.count_usage_from_placement = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.injected_file_content_bytes = 10240 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.injected_file_path_length = 255 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.injected_files           = 5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.instances                = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.key_pairs                = 100 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.metadata_items           = 128 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.ram                      = 51200 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.recheck_quota            = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.server_group_members     = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] quota.server_groups            = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rdp.enabled                    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.image_metadata_prefilter = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.max_attempts         = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.max_placement_results = 1000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.query_placement_for_availability_zone = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.query_placement_for_image_type_support = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] scheduler.workers              = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.host_subset_size = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.isolated_hosts = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.isolated_images = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.pci_in_placement = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.track_instance_changes = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metrics.required               = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metrics.weight_multiplier      = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] metrics.weight_setting         = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] serial_console.enabled         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] serial_console.port_range      = 10000:20000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] serial_console.serialproxy_port = 6083 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.auth_section      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.auth_type         = password {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.cafile            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.certfile          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.collect_timing    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.insecure          = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.keyfile           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.send_service_user_token = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.split_loggers     = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] service_user.timeout           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.agent_enabled            = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.enabled                  = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.html5proxy_port          = 6082 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.image_compression        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.jpeg_compression         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.playback_compression     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.server_listen            = 127.0.0.1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.streaming_mode           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] spice.zlib_compression         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] upgrade_levels.baseapi         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] upgrade_levels.cert            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] upgrade_levels.compute         = auto {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] upgrade_levels.conductor       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] upgrade_levels.scheduler       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.auth_section = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.auth_type = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.cafile = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.certfile = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.insecure = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.keyfile = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vendordata_dynamic_auth.timeout = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.api_retry_count         = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.ca_file                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.cache_prefix            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.cluster_name            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.connection_pool_size    = 10 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.console_delay_seconds   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.datastore_regex         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.host_ip                 = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.host_password           = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.host_port               = 443 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.host_username           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.insecure                = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.integration_bridge      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.maximum_objects         = 100 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.pbm_default_policy      = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.pbm_enabled             = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.pbm_wsdl_location       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.serial_port_proxy_uri   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.serial_port_service_uri = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.task_poll_interval      = 0.5 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.use_linked_clone        = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.vnc_keymap              = en-us {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.vnc_port                = 5900 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vmware.vnc_port_total          = 10000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.auth_schemes               = ['none'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.enabled                    = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.novncproxy_port            = 6080 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.server_listen              = 0.0.0.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.vencrypt_ca_certs          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.vencrypt_client_cert       = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vnc.vencrypt_client_key        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.disable_rootwrap   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.enable_numa_live_migration = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.libvirt_disable_apic = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.client_socket_timeout     = 900 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.default_pool_size         = 1000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.keep_alive                = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.max_header_line           = 16384 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.ssl_ca_file               = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.ssl_cert_file             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.ssl_key_file              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.tcp_keepidle              = 600 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] zvm.ca_file                    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] zvm.cloud_connector_url        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] zvm.reachable_timeout          = 300 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.enforce_new_defaults = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.enforce_scope      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.policy_default_rule = default {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.policy_file        = policy.yaml {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.connection_string     = messaging:// {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.enabled               = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.es_doc_type           = notification {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.es_scroll_size        = 10000 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.es_scroll_time        = 2m {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.filter_error_trace    = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.sentinel_service_name = mymaster {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.socket_timeout        = 0.1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] profiler.trace_sqlalchemy      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] remote_debug.host              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] remote_debug.port              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.ssl      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_notifications.retry = -1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_messaging_notifications.transport_url = **** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.auth_section        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.auth_type           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.cafile              = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.certfile            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.collect_timing      = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.connect_retries     = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.connect_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.endpoint_id         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.endpoint_override   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.insecure            = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.keyfile             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.max_version         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.min_version         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.region_name         = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.service_name        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.service_type        = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.split_loggers       = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.status_code_retries = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.status_code_retry_delay = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.timeout             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.valid_interfaces    = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_limit.version             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_reports.file_event_handler = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] oslo_reports.log_dir           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_ovs_privileged.group  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] vif_plug_ovs_privileged.user   = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.flat_interface = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_ovs.isolate_vif         = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_vif_ovs.per_port_bridge     = False {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] os_brick.lock_path             = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] privsep_osbrick.capabilities   = [21] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] privsep_osbrick.group          = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] privsep_osbrick.helper_command = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] privsep_osbrick.user           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] nova_sys_admin.group           = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] nova_sys_admin.helper_command  = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] nova_sys_admin.user            = None {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG oslo_service.service [None req-4502292c-2ea9-4264-af6d-a5392fb720db None None] ******************************************************************************** {{(pid=71654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 20:31:06 user nova-compute[71654]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Starting native event thread {{(pid=71654) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Starting green dispatch thread {{(pid=71654) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Starting connection event dispatch thread {{(pid=71654) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Connecting to libvirt: qemu:///system {{(pid=71654) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7feb42eb6620> {{(pid=71654) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7feb42eb6620> {{(pid=71654) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 20:31:06 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Connection event '1' reason 'None'
Apr 11 20:31:06 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 20:31:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.mount [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Initialising _HostMountState generation 0 {{(pid=71654) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 20:31:13 user nova-compute[71654]: INFO nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host capabilities <capabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <host>
Apr 11 20:31:13 user nova-compute[71654]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 20:31:13 user nova-compute[71654]:     <cpu>
Apr 11 20:31:13 user nova-compute[71654]:       <arch>x86_64</arch>
Apr 11 20:31:13 user nova-compute[71654]:       <model>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <microcode version='1070'/>
Apr 11 20:31:13 user nova-compute[71654]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='osxsave'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='invtsc'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='rsba'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 20:31:13 user nova-compute[71654]:       <pages unit='KiB' size='4'/>
Apr 11 20:31:13 user nova-compute[71654]:       <pages unit='KiB' size='2048'/>
Apr 11 20:31:13 user nova-compute[71654]:     </cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <power_management>
Apr 11 20:31:13 user nova-compute[71654]:       <suspend_mem/>
Apr 11 20:31:13 user nova-compute[71654]:       <suspend_disk/>
Apr 11 20:31:13 user nova-compute[71654]:       <suspend_hybrid/>
Apr 11 20:31:13 user nova-compute[71654]:     </power_management>
Apr 11 20:31:13 user nova-compute[71654]:     <iommu support='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <migration_features>
Apr 11 20:31:13 user nova-compute[71654]:       <live/>
Apr 11 20:31:13 user nova-compute[71654]:       <uri_transports>
Apr 11 20:31:13 user nova-compute[71654]:         <uri_transport>tcp</uri_transport>
Apr 11 20:31:13 user nova-compute[71654]:         <uri_transport>rdma</uri_transport>
Apr 11 20:31:13 user nova-compute[71654]:       </uri_transports>
Apr 11 20:31:13 user nova-compute[71654]:     </migration_features>
Apr 11 20:31:13 user nova-compute[71654]:     <topology>
Apr 11 20:31:13 user nova-compute[71654]:       <cells num='2'>
Apr 11 20:31:13 user nova-compute[71654]:         <cell id='0'>
Apr 11 20:31:13 user nova-compute[71654]:           <memory unit='KiB'>8189224</memory>
Apr 11 20:31:13 user nova-compute[71654]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 11 20:31:13 user nova-compute[71654]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 20:31:13 user nova-compute[71654]:           <distances>
Apr 11 20:31:13 user nova-compute[71654]:             <sibling id='0' value='10'/>
Apr 11 20:31:13 user nova-compute[71654]:             <sibling id='1' value='20'/>
Apr 11 20:31:13 user nova-compute[71654]:           </distances>
Apr 11 20:31:13 user nova-compute[71654]:           <cpus num='6'>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 20:31:13 user nova-compute[71654]:           </cpus>
Apr 11 20:31:13 user nova-compute[71654]:         </cell>
Apr 11 20:31:13 user nova-compute[71654]:         <cell id='1'>
Apr 11 20:31:13 user nova-compute[71654]:           <memory unit='KiB'>8218796</memory>
Apr 11 20:31:13 user nova-compute[71654]:           <pages unit='KiB' size='4'>2054699</pages>
Apr 11 20:31:13 user nova-compute[71654]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 20:31:13 user nova-compute[71654]:           <distances>
Apr 11 20:31:13 user nova-compute[71654]:             <sibling id='0' value='20'/>
Apr 11 20:31:13 user nova-compute[71654]:             <sibling id='1' value='10'/>
Apr 11 20:31:13 user nova-compute[71654]:           </distances>
Apr 11 20:31:13 user nova-compute[71654]:           <cpus num='6'>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 20:31:13 user nova-compute[71654]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 20:31:13 user nova-compute[71654]:           </cpus>
Apr 11 20:31:13 user nova-compute[71654]:         </cell>
Apr 11 20:31:13 user nova-compute[71654]:       </cells>
Apr 11 20:31:13 user nova-compute[71654]:     </topology>
Apr 11 20:31:13 user nova-compute[71654]:     <cache>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 20:31:13 user nova-compute[71654]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 20:31:13 user nova-compute[71654]:     </cache>
Apr 11 20:31:13 user nova-compute[71654]:     <secmodel>
Apr 11 20:31:13 user nova-compute[71654]:       <model>apparmor</model>
Apr 11 20:31:13 user nova-compute[71654]:       <doi>0</doi>
Apr 11 20:31:13 user nova-compute[71654]:     </secmodel>
Apr 11 20:31:13 user nova-compute[71654]:     <secmodel>
Apr 11 20:31:13 user nova-compute[71654]:       <model>dac</model>
Apr 11 20:31:13 user nova-compute[71654]:       <doi>0</doi>
Apr 11 20:31:13 user nova-compute[71654]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 20:31:13 user nova-compute[71654]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 20:31:13 user nova-compute[71654]:     </secmodel>
Apr 11 20:31:13 user nova-compute[71654]:   </host>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='alpha'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>clipper</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='armv6l'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>spitz</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>nuri</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>kzm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sx1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>z2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>tosa</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>n810</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>n800</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>terrier</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>midway</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>microbit</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>verdex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>highbank</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>akita</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>connex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>collie</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='armv7l'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>spitz</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>nuri</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>kzm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sx1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>z2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>tosa</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>n810</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>n800</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>terrier</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>midway</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>microbit</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>verdex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>highbank</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>akita</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>connex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>collie</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='aarch64'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>spitz</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>nuri</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>kzm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sx1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>z2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>tosa</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>n810</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>n800</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>terrier</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>midway</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>microbit</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>verdex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>highbank</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>akita</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>connex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>collie</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <acpi default='on' toggle='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='cris'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='i686'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>isapc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>microvm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='kvm'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <pae/>
Apr 11 20:31:13 user nova-compute[71654]:       <nonpae/>
Apr 11 20:31:13 user nova-compute[71654]:       <acpi default='on' toggle='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:       <apic default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='m68k'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>an5206</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>q800</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='microblaze'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='microblazeel'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='mips'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='16'>malta</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='mipsel'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='16'>malta</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='mips64'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='16'>malta</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>pica61</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>magnum</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='mips64el'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='16'>malta</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>pica61</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>magnum</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='16'>boston</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='ppc'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mac99</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>40p</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>taihu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='ppc64'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>taihu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>40p</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mac99</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='ppc64le'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>taihu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>40p</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>mac99</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='riscv32'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='8'>spike</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='8'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='riscv64'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='8'>spike</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='8'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='s390x'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='sh4'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>shix</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>r2d</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='sh4eb'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>shix</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>r2d</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='sparc'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>LX</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='sparc64'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>niagara</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='x86_64'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>64</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='1'>isapc</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>microvm</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='kvm'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <acpi default='on' toggle='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:       <apic default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='xtensa'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>sim</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>kc705</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ml605</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx200</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx60</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]:   <guest>
Apr 11 20:31:13 user nova-compute[71654]:     <os_type>hvm</os_type>
Apr 11 20:31:13 user nova-compute[71654]:     <arch name='xtensaeb'>
Apr 11 20:31:13 user nova-compute[71654]:       <wordsize>32</wordsize>
Apr 11 20:31:13 user nova-compute[71654]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='4'>sim</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>kc705</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ml605</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>virt</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx200</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>lx60</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 20:31:13 user nova-compute[71654]:       <domain type='qemu'/>
Apr 11 20:31:13 user nova-compute[71654]:     </arch>
Apr 11 20:31:13 user nova-compute[71654]:     <features>
Apr 11 20:31:13 user nova-compute[71654]:       <cpuselection/>
Apr 11 20:31:13 user nova-compute[71654]:       <deviceboot/>
Apr 11 20:31:13 user nova-compute[71654]:       <disksnapshot default='on' toggle='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     </features>
Apr 11 20:31:13 user nova-compute[71654]:   </guest>
Apr 11 20:31:13 user nova-compute[71654]: </capabilities>
Apr 11 20:31:13 user nova-compute[71654]: 
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-q35-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>i686</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='288'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'/>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='lm'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-i440fx-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>i686</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='255'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'/>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='lm'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ide</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-q35-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>i686</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='288'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'/>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='lm'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-i440fx-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>i686</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='255'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'/>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='lm'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ide</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-q35-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>x86_64</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='288'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>efi</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='invtsc'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='rsba'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-i440fx-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>x86_64</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='255'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>efi</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='invtsc'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='rsba'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ide</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-q35-6.2</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>x86_64</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='288'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>efi</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='invtsc'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='rsba'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 20:31:13 user nova-compute[71654]: <domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 20:31:13 user nova-compute[71654]:   <domain>kvm</domain>
Apr 11 20:31:13 user nova-compute[71654]:   <machine>pc-i440fx-jammy</machine>
Apr 11 20:31:13 user nova-compute[71654]:   <arch>x86_64</arch>
Apr 11 20:31:13 user nova-compute[71654]:   <vcpu max='255'/>
Apr 11 20:31:13 user nova-compute[71654]:   <iothreads supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:   <os supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='firmware'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>efi</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:     <loader supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>rom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pflash</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='readonly'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>yes</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='secure'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>no</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </loader>
Apr 11 20:31:13 user nova-compute[71654]:   </os>
Apr 11 20:31:13 user nova-compute[71654]:   <cpu>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-passthrough' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='hostPassthroughMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='maximum' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='maximumMigratable'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>on</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>off</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='host-model' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <vendor>Intel</vendor>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ss'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='vmx'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pcid'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='hypervisor'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arat'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='umip'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='md-clear'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='invtsc'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibpb'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='ibrs'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-stibp'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='rsba'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='erms'/>
Apr 11 20:31:13 user nova-compute[71654]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:     <mode name='custom' supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>qemu64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>qemu32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>phenom</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>pentium</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>n270</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm64</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>kvm32</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>coreduo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>core2duo</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>athlon</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Westmere</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Snowridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Skylake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>SandyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Penryn</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G5</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G4</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G3</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Opteron_G2</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Opteron_G1</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>IvyBridge</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Icelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Haswell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Rome</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-Milan</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>EPYC</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Dhyana</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cooperlake</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>Conroe</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='no'>Broadwell</model>
Apr 11 20:31:13 user nova-compute[71654]:       <model usable='yes'>486</model>
Apr 11 20:31:13 user nova-compute[71654]:     </mode>
Apr 11 20:31:13 user nova-compute[71654]:   </cpu>
Apr 11 20:31:13 user nova-compute[71654]:   <memoryBacking supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:     <enum name='sourceType'>
Apr 11 20:31:13 user nova-compute[71654]:       <value>file</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>anonymous</value>
Apr 11 20:31:13 user nova-compute[71654]:       <value>memfd</value>
Apr 11 20:31:13 user nova-compute[71654]:     </enum>
Apr 11 20:31:13 user nova-compute[71654]:   </memoryBacking>
Apr 11 20:31:13 user nova-compute[71654]:   <devices>
Apr 11 20:31:13 user nova-compute[71654]:     <disk supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='diskDevice'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>disk</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cdrom</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>floppy</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>lun</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='bus'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ide</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>fdc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sata</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </disk>
Apr 11 20:31:13 user nova-compute[71654]:     <graphics supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='type'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>sdl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vnc</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>spice</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egl-headless</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </graphics>
Apr 11 20:31:13 user nova-compute[71654]:     <video supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='modelType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>cirrus</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>vmvga</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>qxl</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>none</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>bochs</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>ramfb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </video>
Apr 11 20:31:13 user nova-compute[71654]:     <hostdev supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='mode'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>subsystem</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='startupPolicy'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>default</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>mandatory</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>requisite</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>optional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='subsysType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>usb</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>pci</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>scsi</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='capsType'/>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='pciBackend'/>
Apr 11 20:31:13 user nova-compute[71654]:     </hostdev>
Apr 11 20:31:13 user nova-compute[71654]:     <rng supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtio-non-transitional</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>random</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>egd</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>builtin</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </rng>
Apr 11 20:31:13 user nova-compute[71654]:     <filesystem supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='driverType'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>path</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>handle</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>virtiofs</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </filesystem>
Apr 11 20:31:13 user nova-compute[71654]:     <tpm supported='yes'>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='model'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-tis</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>tpm-crb</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:       <enum name='backendModel'>
Apr 11 20:31:13 user nova-compute[71654]:         <value>passthrough</value>
Apr 11 20:31:13 user nova-compute[71654]:         <value>emulator</value>
Apr 11 20:31:13 user nova-compute[71654]:       </enum>
Apr 11 20:31:13 user nova-compute[71654]:     </tpm>
Apr 11 20:31:13 user nova-compute[71654]:   </devices>
Apr 11 20:31:13 user nova-compute[71654]:   <features>
Apr 11 20:31:13 user nova-compute[71654]:     <gic supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:     <vmcoreinfo supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <genid supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backingStoreInput supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <backup supported='yes'/>
Apr 11 20:31:13 user nova-compute[71654]:     <sev supported='no'/>
Apr 11 20:31:13 user nova-compute[71654]:   </features>
Apr 11 20:31:13 user nova-compute[71654]: </domainCapabilities>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71654) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71654) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Checking secure boot support for host arch (x86_64) {{(pid=71654) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 20:31:13 user nova-compute[71654]: INFO nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Secure Boot support detected
Apr 11 20:31:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] cpu compare xml: <cpu match="exact">
Apr 11 20:31:13 user nova-compute[71654]:   <model>Nehalem</model>
Apr 11 20:31:13 user nova-compute[71654]: </cpu>
Apr 11 20:31:13 user nova-compute[71654]:  {{(pid=71654) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 20:31:13 user nova-compute[71654]: INFO nova.virt.node [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Generated node identity da3f0379-92b3-4d28-8352-8945321a69cc
Apr 11 20:31:13 user nova-compute[71654]: INFO nova.virt.node [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Wrote node identity da3f0379-92b3-4d28-8352-8945321a69cc to /opt/stack/data/nova/compute_id
Apr 11 20:31:13 user nova-compute[71654]: WARNING nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Compute nodes ['da3f0379-92b3-4d28-8352-8945321a69cc'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 20:31:13 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 20:31:14 user nova-compute[71654]: WARNING nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 20:31:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:31:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:31:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Hypervisor/Node resource view: name=user free_ram=10829MB free_disk=27.225360870361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:31:14 user nova-compute[71654]: WARNING nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] No compute node record for user:da3f0379-92b3-4d28-8352-8945321a69cc: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host da3f0379-92b3-4d28-8352-8945321a69cc could not be found.
Apr 11 20:31:14 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Compute node record created for user:user with uuid: da3f0379-92b3-4d28-8352-8945321a69cc
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:31:14 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [req-fed88d73-2ae3-424a-a5bb-ba1c8e6fb885] Created resource provider record via placement API for resource provider with UUID da3f0379-92b3-4d28-8352-8945321a69cc and name user.
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71654) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 20:31:14 user nova-compute[71654]: INFO nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] kernel doesn't support AMD SEV
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Libvirt baseline CPU <cpu>
Apr 11 20:31:14 user nova-compute[71654]:   <arch>x86_64</arch>
Apr 11 20:31:14 user nova-compute[71654]:   <model>Nehalem</model>
Apr 11 20:31:14 user nova-compute[71654]:   <vendor>Intel</vendor>
Apr 11 20:31:14 user nova-compute[71654]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 20:31:14 user nova-compute[71654]: </cpu>
Apr 11 20:31:14 user nova-compute[71654]:  {{(pid=71654) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Updated inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Updating resource provider da3f0379-92b3-4d28-8352-8945321a69cc generation from 0 to 1 during operation: update_inventory {{(pid=71654) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Updating resource provider da3f0379-92b3-4d28-8352-8945321a69cc generation from 1 to 2 during operation: update_traits {{(pid=71654) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:31:14 user nova-compute[71654]: DEBUG nova.service [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Creating RPC server for service compute {{(pid=71654) start /opt/stack/nova/nova/service.py:182}}
Apr 11 20:31:15 user nova-compute[71654]: DEBUG nova.service [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Join ServiceGroup membership for this service compute {{(pid=71654) start /opt/stack/nova/nova/service.py:199}}
Apr 11 20:31:15 user nova-compute[71654]: DEBUG nova.servicegroup.drivers.db [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71654) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 20:31:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:31:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:32:05 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:32:06 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:32:06 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:32:06 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=27.139205932617188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:32:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:33:06 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:33:07 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:33:07 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:33:07 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=10160MB free_disk=27.185626983642578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:33:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:33:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:33:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:33:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:33:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:34:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:07 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:34:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:34:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:34:08 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:34:09 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:34:09 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:34:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=10157MB free_disk=26.96146011352539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:34:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:34:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:07 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:07 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:07 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:08 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:35:09 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:09 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=9430MB free_disk=26.964012145996094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:35:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:35:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:35:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:22 user nova-compute[71654]: INFO nova.compute.claims [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Claim successful on node user
Apr 11 20:35:22 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:23 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:23 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:23 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Creating image(s)
Apr 11 20:35:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "/opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "/opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "/opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.part --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG nova.virt.images [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 5eb5099b-ba97-47ac-833b-8ebacdc3051a was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.part /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG nova.policy [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'febd86b9e597436dae2b8c702aff1e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0987ef9e9d6848ce9936af3567da53a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.part /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.converted" returned: 0 in 0.238s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.018s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:24 user nova-compute[71654]: INFO oslo.privsep.daemon [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9qwm_992/privsep.sock']
Apr 11 20:35:24 user sudo[80529]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9qwm_992/privsep.sock
Apr 11 20:35:24 user sudo[80529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 20:35:26 user sudo[80529]: pam_unix(sudo:session): session closed for user root
Apr 11 20:35:26 user nova-compute[71654]: INFO oslo.privsep.daemon [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Spawned new privsep daemon via rootwrap
Apr 11 20:35:26 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 20:35:26 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 20:35:26 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 20:35:26 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80557
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Successfully created port: 9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk 1073741824" returned: 0 in 0.055s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Cannot resize image /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lazy-loading 'migration_context' on Instance uuid 7831232f-c75e-4403-919d-bc2d69b659e5 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Ensure instance console log exists: /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:27 user nova-compute[71654]: INFO nova.compute.claims [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Claim successful on node user
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Creating image(s)
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG nova.policy [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.129s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk 1073741824" returned: 0 in 0.045s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Cannot resize image /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'migration_context' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Ensure instance console log exists: /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:29 user nova-compute[71654]: INFO nova.compute.claims [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Claim successful on node user
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Successfully updated port: 9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquired lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Creating image(s)
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG nova.policy [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-changed-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Refreshing instance network info cache due to event network-changed-9e9edf73-7af6-41ad-9e04-9528f3dde81a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Acquiring lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk 1073741824" returned: 0 in 0.044s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Cannot resize image /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.objects.instance [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'migration_context' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Ensure instance console log exists: /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Successfully created port: d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.network.neutron [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updating instance_info_cache with network_info: [{"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Releasing lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Instance network_info: |[{"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Acquired lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Refreshing network info cache for port 9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Start _get_guest_xml network_info=[{"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1204998430',display_name='tempest-DeleteServersTestJSON-server-1204998430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1204998430',id=1,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0987ef9e9d6848ce9936af3567da53a2',ramdisk_id='',reservation_id='r-x2k9r1s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1287076322',owner_user_name='tempest-DeleteServersTestJSON-1287076322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:23Z,user_data=None,user_id='febd86b9e597436dae2b8c702aff1e8e',uuid=7831232f-c75e-4403-919d-bc2d69b659e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Converting VIF {"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.objects.instance [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lazy-loading 'pci_devices' on Instance uuid 7831232f-c75e-4403-919d-bc2d69b659e5 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:31 user nova-compute[71654]:   <uuid>7831232f-c75e-4403-919d-bc2d69b659e5</uuid>
Apr 11 20:35:31 user nova-compute[71654]:   <name>instance-00000001</name>
Apr 11 20:35:31 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:31 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:31 user nova-compute[71654]:   <metadata>
Apr 11 20:35:31 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:31 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:31 user nova-compute[71654]:       <nova:name>tempest-DeleteServersTestJSON-server-1204998430</nova:name>
Apr 11 20:35:31 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:31</nova:creationTime>
Apr 11 20:35:31 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:31 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:31 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:31 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:user uuid="febd86b9e597436dae2b8c702aff1e8e">tempest-DeleteServersTestJSON-1287076322-project-member</nova:user>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:project uuid="0987ef9e9d6848ce9936af3567da53a2">tempest-DeleteServersTestJSON-1287076322</nova:project>
Apr 11 20:35:31 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:31 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:31 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:31 user nova-compute[71654]:         <nova:port uuid="9e9edf73-7af6-41ad-9e04-9528f3dde81a">
Apr 11 20:35:31 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 20:35:31 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:31 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:31 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:31 user nova-compute[71654]:   </metadata>
Apr 11 20:35:31 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:31 user nova-compute[71654]:     <system>
Apr 11 20:35:31 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:31 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:31 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:31 user nova-compute[71654]:       <entry name="serial">7831232f-c75e-4403-919d-bc2d69b659e5</entry>
Apr 11 20:35:31 user nova-compute[71654]:       <entry name="uuid">7831232f-c75e-4403-919d-bc2d69b659e5</entry>
Apr 11 20:35:31 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:31 user nova-compute[71654]:     </system>
Apr 11 20:35:31 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:31 user nova-compute[71654]:   <os>
Apr 11 20:35:31 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:31 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:31 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:31 user nova-compute[71654]:   </os>
Apr 11 20:35:31 user nova-compute[71654]:   <features>
Apr 11 20:35:31 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:31 user nova-compute[71654]:     <apic/>
Apr 11 20:35:31 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:31 user nova-compute[71654]:   </features>
Apr 11 20:35:31 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:31 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:31 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:31 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:31 user nova-compute[71654]:   </clock>
Apr 11 20:35:31 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:31 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:31 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:31 user nova-compute[71654]:   </cpu>
Apr 11 20:35:31 user nova-compute[71654]:   <devices>
Apr 11 20:35:31 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:31 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:31 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk"/>
Apr 11 20:35:31 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:31 user nova-compute[71654]:     </disk>
Apr 11 20:35:31 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:31 user nova-compute[71654]:       <mac address="fa:16:3e:08:09:3e"/>
Apr 11 20:35:31 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:31 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:31 user nova-compute[71654]:       <target dev="tap9e9edf73-7a"/>
Apr 11 20:35:31 user nova-compute[71654]:     </interface>
Apr 11 20:35:31 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:31 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/console.log" append="off"/>
Apr 11 20:35:31 user nova-compute[71654]:     </serial>
Apr 11 20:35:31 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:31 user nova-compute[71654]:     <video>
Apr 11 20:35:31 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:31 user nova-compute[71654]:     </video>
Apr 11 20:35:31 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:31 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:31 user nova-compute[71654]:     </rng>
Apr 11 20:35:31 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:31 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:31 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:31 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:31 user nova-compute[71654]:   </devices>
Apr 11 20:35:31 user nova-compute[71654]: </domain>
Apr 11 20:35:31 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1204998430',display_name='tempest-DeleteServersTestJSON-server-1204998430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1204998430',id=1,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0987ef9e9d6848ce9936af3567da53a2',ramdisk_id='',reservation_id='r-x2k9r1s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1287076322',owner_user_name='tempest-DeleteServersTestJSON-1287076322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:23Z,user_data=None,user_id='febd86b9e597436dae2b8c702aff1e8e',uuid=7831232f-c75e-4403-919d-bc2d69b659e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Converting VIF {"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG os_vif [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Created schema index Interface.name {{(pid=71654) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Created schema index Port.name {{(pid=71654) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Created schema index Bridge.name {{(pid=71654) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [POLLOUT] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:31 user nova-compute[71654]: INFO oslo.privsep.daemon [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpe6aydvgw/privsep.sock']
Apr 11 20:35:31 user sudo[80624]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpe6aydvgw/privsep.sock
Apr 11 20:35:31 user sudo[80624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 20:35:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Successfully updated port: d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.network.neutron [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updated VIF entry in instance network info cache for port 9e9edf73-7af6-41ad-9e04-9528f3dde81a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.network.neutron [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updating instance_info_cache with network_info: [{"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f75e8a33-9a9b-4247-bf96-0b9aae0aa034 req-334e8634-0c22-48c0-8707-8b918580048f service nova] Releasing lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing instance network info cache due to event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:35:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance network_info: |[{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Start _get_guest_xml network_info=[{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:33 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:33 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482156858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482156858',id=2,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR9qqL3LAGODqH+Z+1EkQCpgM8apAvzyB/jSy1MSWBRkUN4MsKV/vwwKd/cnP2giBycseEQJi5Z0VeYGnUBpd0fbzhscsD5KYv7mXFpxsVb4OZ8zQ+33MPkGmZFDcxTSg==',key_name='tempest-keypair-1950690295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-y79rwl52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=534b82fe-0c07-46dd-bb21-66ad7f6b1397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'pci_devices' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:33 user nova-compute[71654]:   <uuid>534b82fe-0c07-46dd-bb21-66ad7f6b1397</uuid>
Apr 11 20:35:33 user nova-compute[71654]:   <name>instance-00000002</name>
Apr 11 20:35:33 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:33 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:33 user nova-compute[71654]:   <metadata>
Apr 11 20:35:33 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:33 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:33 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1482156858</nova:name>
Apr 11 20:35:33 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:33</nova:creationTime>
Apr 11 20:35:33 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:33 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:33 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:33 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:user uuid="f82468d207064eb288a2c8a167cd7d9d">tempest-AttachVolumeShelveTestJSON-426216861-project-member</nova:user>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:project uuid="0d5fce55f8224068805593f94d5f2d36">tempest-AttachVolumeShelveTestJSON-426216861</nova:project>
Apr 11 20:35:33 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:33 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:33 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:33 user nova-compute[71654]:         <nova:port uuid="d2d4c99b-9fd2-4090-9c8a-072b6625a081">
Apr 11 20:35:33 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:35:33 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:33 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:33 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:33 user nova-compute[71654]:   </metadata>
Apr 11 20:35:33 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:33 user nova-compute[71654]:     <system>
Apr 11 20:35:33 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:33 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:33 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:33 user nova-compute[71654]:       <entry name="serial">534b82fe-0c07-46dd-bb21-66ad7f6b1397</entry>
Apr 11 20:35:33 user nova-compute[71654]:       <entry name="uuid">534b82fe-0c07-46dd-bb21-66ad7f6b1397</entry>
Apr 11 20:35:33 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:33 user nova-compute[71654]:     </system>
Apr 11 20:35:33 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:33 user nova-compute[71654]:   <os>
Apr 11 20:35:33 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:33 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:33 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:33 user nova-compute[71654]:   </os>
Apr 11 20:35:33 user nova-compute[71654]:   <features>
Apr 11 20:35:33 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:33 user nova-compute[71654]:     <apic/>
Apr 11 20:35:33 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:33 user nova-compute[71654]:   </features>
Apr 11 20:35:33 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:33 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:33 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:33 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:33 user nova-compute[71654]:   </clock>
Apr 11 20:35:33 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:33 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:33 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:33 user nova-compute[71654]:   </cpu>
Apr 11 20:35:33 user nova-compute[71654]:   <devices>
Apr 11 20:35:33 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:33 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:33 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk"/>
Apr 11 20:35:33 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:33 user nova-compute[71654]:     </disk>
Apr 11 20:35:33 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:33 user nova-compute[71654]:       <mac address="fa:16:3e:d1:0b:a8"/>
Apr 11 20:35:33 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:33 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:33 user nova-compute[71654]:       <target dev="tapd2d4c99b-9f"/>
Apr 11 20:35:33 user nova-compute[71654]:     </interface>
Apr 11 20:35:33 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:33 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/console.log" append="off"/>
Apr 11 20:35:33 user nova-compute[71654]:     </serial>
Apr 11 20:35:33 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:33 user nova-compute[71654]:     <video>
Apr 11 20:35:33 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:33 user nova-compute[71654]:     </video>
Apr 11 20:35:33 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:33 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:33 user nova-compute[71654]:     </rng>
Apr 11 20:35:33 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:33 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:33 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:33 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:33 user nova-compute[71654]:   </devices>
Apr 11 20:35:33 user nova-compute[71654]: </domain>
Apr 11 20:35:33 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482156858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482156858',id=2,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR9qqL3LAGODqH+Z+1EkQCpgM8apAvzyB/jSy1MSWBRkUN4MsKV/vwwKd/cnP2giBycseEQJi5Z0VeYGnUBpd0fbzhscsD5KYv7mXFpxsVb4OZ8zQ+33MPkGmZFDcxTSg==',key_name='tempest-keypair-1950690295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-y79rwl52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=534b82fe-0c07-46dd-bb21-66ad7f6b1397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG os_vif [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:33 user sudo[80624]: pam_unix(sudo:session): session closed for user root
Apr 11 20:35:33 user nova-compute[71654]: INFO oslo.privsep.daemon [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Spawned new privsep daemon via rootwrap
Apr 11 20:35:33 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 20:35:33 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 20:35:33 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 20:35:33 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80630
Apr 11 20:35:33 user nova-compute[71654]: WARNING oslo_privsep.priv_context [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] privsep daemon already running
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e9edf73-7a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e9edf73-7a, col_values=(('external_ids', {'iface-id': '9e9edf73-7af6-41ad-9e04-9528f3dde81a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:09:3e', 'vm-uuid': '7831232f-c75e-4403-919d-bc2d69b659e5'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: INFO os_vif [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a')
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2d4c99b-9f, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2d4c99b-9f, col_values=(('external_ids', {'iface-id': 'd2d4c99b-9fd2-4090-9c8a-072b6625a081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0b:a8', 'vm-uuid': '534b82fe-0c07-46dd-bb21-66ad7f6b1397'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Successfully created port: 21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:33 user nova-compute[71654]: INFO os_vif [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f')
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] No VIF found with MAC fa:16:3e:08:09:3e, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No VIF found with MAC fa:16:3e:d1:0b:a8, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updated VIF entry in instance network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-60e46242-6efd-4724-b6e2-2d27bd1511af req-17f6f5cd-a3e7-4a68-9360-72f49125557c service nova] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:34 user nova-compute[71654]: INFO nova.compute.claims [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Claim successful on node user
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Creating image(s)
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG nova.policy [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '127b201d67de4bacaed034d4becdc955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8329ebeb037462d864dd5cf8aefc6b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk 1073741824" returned: 0 in 0.041s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.119s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Cannot resize image /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'migration_context' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Ensure instance console log exists: /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Successfully updated port: 21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-changed-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Refreshing instance network info cache due to event network-changed-21864ca9-0ae0-4591-a5bc-fac2428743cb. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance network_info: |[{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Refreshing network info cache for port 21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start _get_guest_xml network_info=[{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:38 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:38 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-120119093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.objects.instance [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_devices' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245338.343742, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] VM Resumed (Lifecycle Event)
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:38 user nova-compute[71654]:   <uuid>dadac585-3a7c-40d8-a335-fc2603588c28</uuid>
Apr 11 20:35:38 user nova-compute[71654]:   <name>instance-00000003</name>
Apr 11 20:35:38 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:38 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:38 user nova-compute[71654]:   <metadata>
Apr 11 20:35:38 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:38 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:38 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-120119093</nova:name>
Apr 11 20:35:38 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:38</nova:creationTime>
Apr 11 20:35:38 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:38 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:38 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:38 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:35:38 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:38 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:38 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:38 user nova-compute[71654]:         <nova:port uuid="21864ca9-0ae0-4591-a5bc-fac2428743cb">
Apr 11 20:35:38 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:35:38 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:38 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:38 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:38 user nova-compute[71654]:   </metadata>
Apr 11 20:35:38 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:38 user nova-compute[71654]:     <system>
Apr 11 20:35:38 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:38 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:38 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:38 user nova-compute[71654]:       <entry name="serial">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:35:38 user nova-compute[71654]:       <entry name="uuid">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:35:38 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:38 user nova-compute[71654]:     </system>
Apr 11 20:35:38 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:38 user nova-compute[71654]:   <os>
Apr 11 20:35:38 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:38 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:38 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:38 user nova-compute[71654]:   </os>
Apr 11 20:35:38 user nova-compute[71654]:   <features>
Apr 11 20:35:38 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:38 user nova-compute[71654]:     <apic/>
Apr 11 20:35:38 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:38 user nova-compute[71654]:   </features>
Apr 11 20:35:38 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:38 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:38 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:38 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:38 user nova-compute[71654]:   </clock>
Apr 11 20:35:38 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:38 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:38 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:38 user nova-compute[71654]:   </cpu>
Apr 11 20:35:38 user nova-compute[71654]:   <devices>
Apr 11 20:35:38 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:38 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:38 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk"/>
Apr 11 20:35:38 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:38 user nova-compute[71654]:     </disk>
Apr 11 20:35:38 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:38 user nova-compute[71654]:       <mac address="fa:16:3e:76:b1:a7"/>
Apr 11 20:35:38 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:38 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:38 user nova-compute[71654]:       <target dev="tap21864ca9-0a"/>
Apr 11 20:35:38 user nova-compute[71654]:     </interface>
Apr 11 20:35:38 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:38 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log" append="off"/>
Apr 11 20:35:38 user nova-compute[71654]:     </serial>
Apr 11 20:35:38 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:38 user nova-compute[71654]:     <video>
Apr 11 20:35:38 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:38 user nova-compute[71654]:     </video>
Apr 11 20:35:38 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:38 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:38 user nova-compute[71654]:     </rng>
Apr 11 20:35:38 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:38 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:38 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:38 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:38 user nova-compute[71654]:   </devices>
Apr 11 20:35:38 user nova-compute[71654]: </domain>
Apr 11 20:35:38 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-120119093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG os_vif [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21864ca9-0a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21864ca9-0a, col_values=(('external_ids', {'iface-id': '21864ca9-0ae0-4591-a5bc-fac2428743cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b1:a7', 'vm-uuid': 'dadac585-3a7c-40d8-a335-fc2603588c28'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance spawned successfully.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Instance spawned successfully.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:35:38 user nova-compute[71654]: INFO os_vif [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:76:b1:a7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245338.3448985, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] VM Started (Lifecycle Event)
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Took 10.85 seconds to spawn the instance on the hypervisor.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Took 15.25 seconds to spawn the instance on the hypervisor.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] No waiting events found dispatching network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:38 user nova-compute[71654]: WARNING nova.compute.manager [req-d2fad2e7-fcdd-4dbb-bfd7-53130980c22e req-88b57964-ab93-4f3f-92ab-d4db5e69e50f service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received unexpected event network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance with vm_state building and task_state spawning.
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245338.3539553, 7831232f-c75e-4403-919d-bc2d69b659e5 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] VM Resumed (Lifecycle Event)
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Took 11.54 seconds to build instance.
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Took 16.67 seconds to build instance.
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8b8e2d7a-3497-42ce-bc4a-7ead0afb3167 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.660s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-67469652-1ff0-481d-95c0-0b6c8e6787ff tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.885s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245338.3543165, 7831232f-c75e-4403-919d-bc2d69b659e5 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] VM Started (Lifecycle Event)
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Successfully created port: 1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG nova.network.neutron [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updated VIF entry in instance network info cache for port 21864ca9-0ae0-4591-a5bc-fac2428743cb. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG nova.network.neutron [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f7ce43cf-c931-443e-9364-9b96337de494 req-c990b4a0-ab7c-495a-946a-f1d4b385e282 service nova] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] No waiting events found dispatching network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:40 user nova-compute[71654]: WARNING nova.compute.manager [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received unexpected event network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance with vm_state active and task_state None.
Apr 11 20:35:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:40 user nova-compute[71654]: WARNING nova.compute.manager [req-163f53b9-a1e9-4298-acd2-96513ae3da02 req-17a4982c-436a-48a7-a759-830fef8b0250 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state active and task_state None.
Apr 11 20:35:41 user nova-compute[71654]: DEBUG nova.compute.manager [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:41 user nova-compute[71654]: DEBUG nova.compute.manager [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:41 user nova-compute[71654]: WARNING nova.compute.manager [req-5d36fa42-970c-4cf3-891d-71c956be9162 req-709ceb8a-68f5-4ef9-8913-d9d7e4d6cca6 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state building and task_state spawning.
Apr 11 20:35:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Successfully updated port: 1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing instance network info cache due to event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245342.6241367, dadac585-3a7c-40d8-a335-fc2603588c28 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Resumed (Lifecycle Event)
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:42 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance spawned successfully.
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245342.627559, dadac585-3a7c-40d8-a335-fc2603588c28 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Started (Lifecycle Event)
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:42 user nova-compute[71654]: INFO nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Took 13.12 seconds to spawn the instance on the hypervisor.
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance network_info: |[{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.neutron [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Start _get_guest_xml network_info=[{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:42 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:42 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743051561',display_name='tempest-ServerStableDeviceRescueTest-server-1743051561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743051561',id=4,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8edukNlRzRt2xM1Yz79RSQhOkxsm8ccsONALiSEdR71l6YiK0hGivRdMEIPe6FhH/dBsOBuEPFT6mch0ytfQkkG8lca42/DiYBmO2hVEc7hq5brWI1oZCdGBeI4245iw==',key_name='tempest-keypair-2032053389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8329ebeb037462d864dd5cf8aefc6b8',ramdisk_id='',reservation_id='r-nn7gj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-435801344',owner_user_name='tempest-ServerStableDeviceRescueTest-435801344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127b201d67de4bacaed034d4becdc955',uuid=fe5fb157-6ca9-4e9f-87c6-11300909fdca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converting VIF {"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'pci_devices' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:42 user nova-compute[71654]: WARNING nova.compute.manager [req-d4bf0224-a29d-4674-aa7d-8ef079f2bea0 req-12540551-d81d-4ffd-ba62-948393a1ad7e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state active and task_state None.
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:42 user nova-compute[71654]:   <uuid>fe5fb157-6ca9-4e9f-87c6-11300909fdca</uuid>
Apr 11 20:35:42 user nova-compute[71654]:   <name>instance-00000004</name>
Apr 11 20:35:42 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:42 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:42 user nova-compute[71654]:   <metadata>
Apr 11 20:35:42 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:42 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:42 user nova-compute[71654]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1743051561</nova:name>
Apr 11 20:35:42 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:42</nova:creationTime>
Apr 11 20:35:42 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:42 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:42 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:42 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:user uuid="127b201d67de4bacaed034d4becdc955">tempest-ServerStableDeviceRescueTest-435801344-project-member</nova:user>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:project uuid="e8329ebeb037462d864dd5cf8aefc6b8">tempest-ServerStableDeviceRescueTest-435801344</nova:project>
Apr 11 20:35:42 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:42 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:42 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:42 user nova-compute[71654]:         <nova:port uuid="1ef9bc31-64d9-48ac-b54c-80d0b4487897">
Apr 11 20:35:42 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:35:42 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:42 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:42 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:42 user nova-compute[71654]:   </metadata>
Apr 11 20:35:42 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:42 user nova-compute[71654]:     <system>
Apr 11 20:35:42 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:42 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:42 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:42 user nova-compute[71654]:       <entry name="serial">fe5fb157-6ca9-4e9f-87c6-11300909fdca</entry>
Apr 11 20:35:42 user nova-compute[71654]:       <entry name="uuid">fe5fb157-6ca9-4e9f-87c6-11300909fdca</entry>
Apr 11 20:35:42 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:42 user nova-compute[71654]:     </system>
Apr 11 20:35:42 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:42 user nova-compute[71654]:   <os>
Apr 11 20:35:42 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:42 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:42 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:42 user nova-compute[71654]:   </os>
Apr 11 20:35:42 user nova-compute[71654]:   <features>
Apr 11 20:35:42 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:42 user nova-compute[71654]:     <apic/>
Apr 11 20:35:42 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:42 user nova-compute[71654]:   </features>
Apr 11 20:35:42 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:42 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:42 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:42 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:42 user nova-compute[71654]:   </clock>
Apr 11 20:35:42 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:42 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:42 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:42 user nova-compute[71654]:   </cpu>
Apr 11 20:35:42 user nova-compute[71654]:   <devices>
Apr 11 20:35:42 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:42 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:42 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk"/>
Apr 11 20:35:42 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:42 user nova-compute[71654]:     </disk>
Apr 11 20:35:42 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:42 user nova-compute[71654]:       <mac address="fa:16:3e:7c:29:9c"/>
Apr 11 20:35:42 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:42 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:42 user nova-compute[71654]:       <target dev="tap1ef9bc31-64"/>
Apr 11 20:35:42 user nova-compute[71654]:     </interface>
Apr 11 20:35:42 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:42 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/console.log" append="off"/>
Apr 11 20:35:42 user nova-compute[71654]:     </serial>
Apr 11 20:35:42 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:42 user nova-compute[71654]:     <video>
Apr 11 20:35:42 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:42 user nova-compute[71654]:     </video>
Apr 11 20:35:42 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:42 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:42 user nova-compute[71654]:     </rng>
Apr 11 20:35:42 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:42 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:42 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:42 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:42 user nova-compute[71654]:   </devices>
Apr 11 20:35:42 user nova-compute[71654]: </domain>
Apr 11 20:35:42 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743051561',display_name='tempest-ServerStableDeviceRescueTest-server-1743051561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743051561',id=4,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8edukNlRzRt2xM1Yz79RSQhOkxsm8ccsONALiSEdR71l6YiK0hGivRdMEIPe6FhH/dBsOBuEPFT6mch0ytfQkkG8lca42/DiYBmO2hVEc7hq5brWI1oZCdGBeI4245iw==',key_name='tempest-keypair-2032053389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8329ebeb037462d864dd5cf8aefc6b8',ramdisk_id='',reservation_id='r-nn7gj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-435801344',owner_user_name='tempest-ServerStableDeviceRescueTest-435801344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127b201d67de4bacaed034d4becdc955',uuid=fe5fb157-6ca9-4e9f-87c6-11300909fdca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converting VIF {"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG os_vif [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ef9bc31-64, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ef9bc31-64, col_values=(('external_ids', {'iface-id': '1ef9bc31-64d9-48ac-b54c-80d0b4487897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:29:9c', 'vm-uuid': 'fe5fb157-6ca9-4e9f-87c6-11300909fdca'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:43 user nova-compute[71654]: INFO os_vif [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64')
Apr 11 20:35:43 user nova-compute[71654]: INFO nova.compute.manager [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Took 13.94 seconds to build instance.
Apr 11 20:35:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52a81bce-095d-4f21-b950-5d01e8c4a620 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.059s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No VIF found with MAC fa:16:3e:7c:29:9c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:43 user nova-compute[71654]: WARNING nova.compute.manager [req-5594996c-f894-434f-a195-820b4290fa5e req-a2e93376-5a96-4633-9ccd-d6d6eead6799 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state None.
Apr 11 20:35:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updated VIF entry in instance network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-285d3070-711d-474b-8f5c-70ad0a50b174 req-8183cec2-8212-4a86-8c0b-13620bfac100 service nova] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:44 user nova-compute[71654]: INFO nova.compute.claims [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Claim successful on node user
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Creating image(s)
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "/opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "/opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "/opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.045s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG nova.policy [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f180b6f746141ae9e52234fd8804b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2a37d13cdd4a8f90c4cd205d4f8b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.329s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.192s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk 1073741824" returned: 0 in 0.110s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.209s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Cannot resize image /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'migration_context' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Ensure instance console log exists: /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:47 user nova-compute[71654]: INFO nova.compute.claims [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Claim successful on node user
Apr 11 20:35:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:47 user nova-compute[71654]: WARNING nova.compute.manager [req-67c50fbe-1805-4973-8d17-195ae859b43d req-fb4ff99f-09a1-46c5-816e-70e7c058799a service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state building and task_state spawning.
Apr 11 20:35:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245348.034876, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Resumed (Lifecycle Event)
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance spawned successfully.
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Successfully created port: 4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245348.041388, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Started (Lifecycle Event)
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Took 12.66 seconds to spawn the instance on the hypervisor.
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.compute.manager [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Took 13.74 seconds to build instance.
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ebe8baa8-6a78-4d36-9a66-ece57b9ab23b tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.918s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Creating image(s)
Apr 11 20:35:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "/opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "/opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG nova.policy [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.319s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Successfully updated port: 4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquired lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.339s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-changed-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Refreshing instance network info cache due to event network-changed-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Acquiring lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:49 user nova-compute[71654]: WARNING nova.compute.manager [req-13021a9c-fb50-41b6-98a0-e8a7198de007 req-681dbb61-b8e3-49c9-89ec-fe582f895f73 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state active and task_state None.
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk 1073741824" returned: 0 in 0.089s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.445s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.209s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Cannot resize image /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.objects.instance [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'migration_context' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Ensure instance console log exists: /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updating instance_info_cache with network_info: [{"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Releasing lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Instance network_info: |[{"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Acquired lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Refreshing network info cache for port 4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Start _get_guest_xml network_info=[{"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-717469447',display_name='tempest-TestVolumeSwap-server-717469447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-717469447',id=5,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHMuKtVqAgzsp5/expcX1bSxUaW1NpVgPU1mtUX80BTfPGihWz8OjN8J0Als+77YSgxutHOeytPJue1OlY4uegNXWVZVzcmOsVm9ZJdBkbHsA7NF/lHdxwZKph7epnUIA==',key_name='tempest-keypair-208847137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f2a37d13cdd4a8f90c4cd205d4f8b76',ramdisk_id='',reservation_id='r-fv2k4ei8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-384933576',owner_user_name='tempest-TestVolumeSwap-384933576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f180b6f746141ae9e52234fd8804b29',uuid=cafd98ea-fe9e-4159-a454-6833bdcb8934,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Converting VIF {"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.objects.instance [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'pci_devices' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:50 user nova-compute[71654]:   <uuid>cafd98ea-fe9e-4159-a454-6833bdcb8934</uuid>
Apr 11 20:35:50 user nova-compute[71654]:   <name>instance-00000005</name>
Apr 11 20:35:50 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:50 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:50 user nova-compute[71654]:   <metadata>
Apr 11 20:35:50 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:50 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:50 user nova-compute[71654]:       <nova:name>tempest-TestVolumeSwap-server-717469447</nova:name>
Apr 11 20:35:50 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:50</nova:creationTime>
Apr 11 20:35:50 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:50 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:50 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:50 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:user uuid="8f180b6f746141ae9e52234fd8804b29">tempest-TestVolumeSwap-384933576-project-member</nova:user>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:project uuid="2f2a37d13cdd4a8f90c4cd205d4f8b76">tempest-TestVolumeSwap-384933576</nova:project>
Apr 11 20:35:50 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:50 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:50 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:50 user nova-compute[71654]:         <nova:port uuid="4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6">
Apr 11 20:35:50 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 20:35:50 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:50 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:50 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:50 user nova-compute[71654]:   </metadata>
Apr 11 20:35:50 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:50 user nova-compute[71654]:     <system>
Apr 11 20:35:50 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:50 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:50 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:50 user nova-compute[71654]:       <entry name="serial">cafd98ea-fe9e-4159-a454-6833bdcb8934</entry>
Apr 11 20:35:50 user nova-compute[71654]:       <entry name="uuid">cafd98ea-fe9e-4159-a454-6833bdcb8934</entry>
Apr 11 20:35:50 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:50 user nova-compute[71654]:     </system>
Apr 11 20:35:50 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:50 user nova-compute[71654]:   <os>
Apr 11 20:35:50 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:50 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:50 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:50 user nova-compute[71654]:   </os>
Apr 11 20:35:50 user nova-compute[71654]:   <features>
Apr 11 20:35:50 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:50 user nova-compute[71654]:     <apic/>
Apr 11 20:35:50 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:50 user nova-compute[71654]:   </features>
Apr 11 20:35:50 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:50 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:50 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:50 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:50 user nova-compute[71654]:   </clock>
Apr 11 20:35:50 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:50 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:50 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:50 user nova-compute[71654]:   </cpu>
Apr 11 20:35:50 user nova-compute[71654]:   <devices>
Apr 11 20:35:50 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:50 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:50 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk"/>
Apr 11 20:35:50 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:50 user nova-compute[71654]:     </disk>
Apr 11 20:35:50 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:50 user nova-compute[71654]:       <mac address="fa:16:3e:6d:16:ca"/>
Apr 11 20:35:50 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:50 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:50 user nova-compute[71654]:       <target dev="tap4aa6ccbf-2c"/>
Apr 11 20:35:50 user nova-compute[71654]:     </interface>
Apr 11 20:35:50 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:50 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/console.log" append="off"/>
Apr 11 20:35:50 user nova-compute[71654]:     </serial>
Apr 11 20:35:50 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:50 user nova-compute[71654]:     <video>
Apr 11 20:35:50 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:50 user nova-compute[71654]:     </video>
Apr 11 20:35:50 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:50 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:50 user nova-compute[71654]:     </rng>
Apr 11 20:35:50 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:50 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:50 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:50 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:50 user nova-compute[71654]:   </devices>
Apr 11 20:35:50 user nova-compute[71654]: </domain>
Apr 11 20:35:50 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-717469447',display_name='tempest-TestVolumeSwap-server-717469447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-717469447',id=5,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHMuKtVqAgzsp5/expcX1bSxUaW1NpVgPU1mtUX80BTfPGihWz8OjN8J0Als+77YSgxutHOeytPJue1OlY4uegNXWVZVzcmOsVm9ZJdBkbHsA7NF/lHdxwZKph7epnUIA==',key_name='tempest-keypair-208847137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f2a37d13cdd4a8f90c4cd205d4f8b76',ramdisk_id='',reservation_id='r-fv2k4ei8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-384933576',owner_user_name='tempest-TestVolumeSwap-384933576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f180b6f746141ae9e52234fd8804b29',uuid=cafd98ea-fe9e-4159-a454-6833bdcb8934,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Converting VIF {"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG os_vif [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aa6ccbf-2c, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4aa6ccbf-2c, col_values=(('external_ids', {'iface-id': '4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:16:ca', 'vm-uuid': 'cafd98ea-fe9e-4159-a454-6833bdcb8934'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Successfully created port: 1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:50 user nova-compute[71654]: INFO os_vif [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c')
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] No VIF found with MAC fa:16:3e:6d:16:ca, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updated VIF entry in instance network info cache for port 4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:35:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updating instance_info_cache with network_info: [{"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-70cbe1ed-55be-4575-85fe-c0a08ebe0a5c req-e6ef3ecc-3ab1-472b-bf45-026b6b084a1c service nova] Releasing lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Successfully updated port: 1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquired lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-changed-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Refreshing instance network info cache due to event network-changed-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Acquiring lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] No waiting events found dispatching network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:52 user nova-compute[71654]: WARNING nova.compute.manager [req-31a07fde-cd28-4478-93ce-d33bd9894646 req-b333bd65-8e11-4f09-9e82-0212ac643596 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received unexpected event network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance with vm_state building and task_state spawning.
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.network.neutron [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updating instance_info_cache with network_info: [{"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Releasing lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Instance network_info: |[{"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Acquired lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Refreshing network info cache for port 1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Start _get_guest_xml network_info=[{"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:53 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:53 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1907534775',display_name='tempest-VolumesAdminNegativeTest-server-1907534775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1907534775',id=6,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW/t9YZ66Cz3VZyVg3QGLDVCdTkc7Tgb97mAXHXYB6LoyZLSe0s0IjH7upGLuhJ75+s83H49TRIFzJlt1rme3byHdLvFn1IUIl2DAKKNpuUl7UzAvXGLqeDLFOTod8Glg==',key_name='tempest-keypair-189322231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab02b2eef8d40f18b755b63d2a14c9b',ramdisk_id='',reservation_id='r-2tzun3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-878898162',owner_user_name='tempest-VolumesAdminNegativeTest-878898162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af25924dd6564739a52fd957edceb143',uuid=52b7250e-a85d-4c3f-93e7-ac05ebd13be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converting VIF {"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:53 user nova-compute[71654]:   <uuid>52b7250e-a85d-4c3f-93e7-ac05ebd13be1</uuid>
Apr 11 20:35:53 user nova-compute[71654]:   <name>instance-00000006</name>
Apr 11 20:35:53 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:53 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:53 user nova-compute[71654]:   <metadata>
Apr 11 20:35:53 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:53 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:53 user nova-compute[71654]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1907534775</nova:name>
Apr 11 20:35:53 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:53</nova:creationTime>
Apr 11 20:35:53 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:53 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:53 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:53 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:user uuid="af25924dd6564739a52fd957edceb143">tempest-VolumesAdminNegativeTest-878898162-project-member</nova:user>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:project uuid="0ab02b2eef8d40f18b755b63d2a14c9b">tempest-VolumesAdminNegativeTest-878898162</nova:project>
Apr 11 20:35:53 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:53 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:53 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:53 user nova-compute[71654]:         <nova:port uuid="1a812da6-b951-42d6-a9ef-d61fdb2f6ccd">
Apr 11 20:35:53 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:35:53 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:53 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:53 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:53 user nova-compute[71654]:   </metadata>
Apr 11 20:35:53 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:53 user nova-compute[71654]:     <system>
Apr 11 20:35:53 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:53 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:53 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:53 user nova-compute[71654]:       <entry name="serial">52b7250e-a85d-4c3f-93e7-ac05ebd13be1</entry>
Apr 11 20:35:53 user nova-compute[71654]:       <entry name="uuid">52b7250e-a85d-4c3f-93e7-ac05ebd13be1</entry>
Apr 11 20:35:53 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:53 user nova-compute[71654]:     </system>
Apr 11 20:35:53 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:53 user nova-compute[71654]:   <os>
Apr 11 20:35:53 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:53 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:53 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:53 user nova-compute[71654]:   </os>
Apr 11 20:35:53 user nova-compute[71654]:   <features>
Apr 11 20:35:53 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:53 user nova-compute[71654]:     <apic/>
Apr 11 20:35:53 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:53 user nova-compute[71654]:   </features>
Apr 11 20:35:53 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:53 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:53 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:53 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:53 user nova-compute[71654]:   </clock>
Apr 11 20:35:53 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:53 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:53 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:53 user nova-compute[71654]:   </cpu>
Apr 11 20:35:53 user nova-compute[71654]:   <devices>
Apr 11 20:35:53 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:53 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:53 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk"/>
Apr 11 20:35:53 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:53 user nova-compute[71654]:     </disk>
Apr 11 20:35:53 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:53 user nova-compute[71654]:       <mac address="fa:16:3e:44:b5:bf"/>
Apr 11 20:35:53 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:53 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:53 user nova-compute[71654]:       <target dev="tap1a812da6-b9"/>
Apr 11 20:35:53 user nova-compute[71654]:     </interface>
Apr 11 20:35:53 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:53 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/console.log" append="off"/>
Apr 11 20:35:53 user nova-compute[71654]:     </serial>
Apr 11 20:35:53 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:53 user nova-compute[71654]:     <video>
Apr 11 20:35:53 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:53 user nova-compute[71654]:     </video>
Apr 11 20:35:53 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:53 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:53 user nova-compute[71654]:     </rng>
Apr 11 20:35:53 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:53 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:53 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:53 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:53 user nova-compute[71654]:   </devices>
Apr 11 20:35:53 user nova-compute[71654]: </domain>
Apr 11 20:35:53 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1907534775',display_name='tempest-VolumesAdminNegativeTest-server-1907534775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1907534775',id=6,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW/t9YZ66Cz3VZyVg3QGLDVCdTkc7Tgb97mAXHXYB6LoyZLSe0s0IjH7upGLuhJ75+s83H49TRIFzJlt1rme3byHdLvFn1IUIl2DAKKNpuUl7UzAvXGLqeDLFOTod8Glg==',key_name='tempest-keypair-189322231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab02b2eef8d40f18b755b63d2a14c9b',ramdisk_id='',reservation_id='r-2tzun3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-878898162',owner_user_name='tempest-VolumesAdminNegativeTest-878898162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af25924dd6564739a52fd957edceb143',uuid=52b7250e-a85d-4c3f-93e7-ac05ebd13be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converting VIF {"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG os_vif [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a812da6-b9, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a812da6-b9, col_values=(('external_ids', {'iface-id': '1a812da6-b951-42d6-a9ef-d61fdb2f6ccd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:b5:bf', 'vm-uuid': '52b7250e-a85d-4c3f-93e7-ac05ebd13be1'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:53 user nova-compute[71654]: INFO os_vif [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9')
Apr 11 20:35:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:53 user nova-compute[71654]: INFO nova.compute.claims [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Claim successful on node user
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No VIF found with MAC fa:16:3e:44:b5:bf, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.network.neutron [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updated VIF entry in instance network info cache for port 1a812da6-b951-42d6-a9ef-d61fdb2f6ccd. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.network.neutron [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updating instance_info_cache with network_info: [{"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-586970c4-0b9c-4b40-be85-8f74242a5c49 req-643127ca-df75-408a-8cd2-34567fe0ed9c service nova] Releasing lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:54 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.policy [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] No waiting events found dispatching network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:54 user nova-compute[71654]: WARNING nova.compute.manager [req-d6c5c283-a705-4684-a136-c88756441f75 req-d7f2880c-cb97-4663-800a-290abb2f9050 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received unexpected event network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance with vm_state building and task_state spawning.
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:54 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Creating image(s)
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.172s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.160s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk 1073741824" returned: 0 in 0.103s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245355.5452976, cafd98ea-fe9e-4159-a454-6833bdcb8934 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] VM Resumed (Lifecycle Event)
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.187s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Instance spawned successfully.
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245355.5491822, cafd98ea-fe9e-4159-a454-6833bdcb8934 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] VM Started (Lifecycle Event)
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Cannot resize image /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'migration_context' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Ensure instance console log exists: /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:55 user nova-compute[71654]: INFO nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Took 10.57 seconds to spawn the instance on the hypervisor.
Apr 11 20:35:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] No waiting events found dispatching network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:56 user nova-compute[71654]: WARNING nova.compute.manager [req-c7bf9342-e8a4-41d9-b749-e0f5c5710a9d req-0383bd56-dfe7-4e2a-a628-39647fb4fa5b service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received unexpected event network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance with vm_state building and task_state spawning.
Apr 11 20:35:56 user nova-compute[71654]: INFO nova.compute.manager [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Took 11.82 seconds to build instance.
Apr 11 20:35:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-78ad07d8-1035-46d3-9106-39e7c00a7661 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.010s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:56 user nova-compute[71654]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Successfully created port: 81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:35:57 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245357.98338, 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:57 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] VM Resumed (Lifecycle Event)
Apr 11 20:35:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:35:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Instance spawned successfully.
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245357.9900692, 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] VM Started (Lifecycle Event)
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Successfully updated port: 81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Took 9.30 seconds to spawn the instance on the hypervisor.
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquired lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] No waiting events found dispatching network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:35:58 user nova-compute[71654]: WARNING nova.compute.manager [req-6205b4ba-a0e4-4f84-9bfd-eac04f5641e4 req-92e026d9-0eae-4328-9ed3-18e5864000b5 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received unexpected event network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance with vm_state building and task_state spawning.
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.compute.manager [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Took 10.88 seconds to build instance.
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-551591bd-d48f-43c1-8cdd-20abdd872307 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.120s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:35:58 user nova-compute[71654]: INFO nova.compute.claims [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Claim successful on node user
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Releasing lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Instance network_info: |[{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Start _get_guest_xml network_info=[{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:35:58 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:58 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:35:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.objects.instance [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'pci_devices' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:35:59 user nova-compute[71654]:   <uuid>b7d2dbd0-544c-4146-b35c-125eef81c281</uuid>
Apr 11 20:35:59 user nova-compute[71654]:   <name>instance-00000007</name>
Apr 11 20:35:59 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:35:59 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:35:59 user nova-compute[71654]:   <metadata>
Apr 11 20:35:59 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:35:59 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:35:59 user nova-compute[71654]:       <nova:name>tempest-device-tagging-server-1083627248</nova:name>
Apr 11 20:35:59 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:35:58</nova:creationTime>
Apr 11 20:35:59 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:35:59 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:35:59 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:35:59 user nova-compute[71654]:       <nova:owner>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:user uuid="05684678d0cd4ccea78238d20d561f3f">tempest-TaggedAttachmentsTest-1851174411-project-member</nova:user>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:project uuid="d40e31bd9e6e4d5e9cff3e4f2c1cf412">tempest-TaggedAttachmentsTest-1851174411</nova:project>
Apr 11 20:35:59 user nova-compute[71654]:       </nova:owner>
Apr 11 20:35:59 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:35:59 user nova-compute[71654]:       <nova:ports>
Apr 11 20:35:59 user nova-compute[71654]:         <nova:port uuid="81fa518b-09cd-4072-b9be-2f74d2453d76">
Apr 11 20:35:59 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:35:59 user nova-compute[71654]:         </nova:port>
Apr 11 20:35:59 user nova-compute[71654]:       </nova:ports>
Apr 11 20:35:59 user nova-compute[71654]:     </nova:instance>
Apr 11 20:35:59 user nova-compute[71654]:   </metadata>
Apr 11 20:35:59 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:35:59 user nova-compute[71654]:     <system>
Apr 11 20:35:59 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:35:59 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:35:59 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:35:59 user nova-compute[71654]:       <entry name="serial">b7d2dbd0-544c-4146-b35c-125eef81c281</entry>
Apr 11 20:35:59 user nova-compute[71654]:       <entry name="uuid">b7d2dbd0-544c-4146-b35c-125eef81c281</entry>
Apr 11 20:35:59 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:35:59 user nova-compute[71654]:     </system>
Apr 11 20:35:59 user nova-compute[71654]:   </sysinfo>
Apr 11 20:35:59 user nova-compute[71654]:   <os>
Apr 11 20:35:59 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:35:59 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:35:59 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:35:59 user nova-compute[71654]:   </os>
Apr 11 20:35:59 user nova-compute[71654]:   <features>
Apr 11 20:35:59 user nova-compute[71654]:     <acpi/>
Apr 11 20:35:59 user nova-compute[71654]:     <apic/>
Apr 11 20:35:59 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:35:59 user nova-compute[71654]:   </features>
Apr 11 20:35:59 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:35:59 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:35:59 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:35:59 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:35:59 user nova-compute[71654]:   </clock>
Apr 11 20:35:59 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:35:59 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:35:59 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:35:59 user nova-compute[71654]:   </cpu>
Apr 11 20:35:59 user nova-compute[71654]:   <devices>
Apr 11 20:35:59 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:35:59 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:35:59 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk"/>
Apr 11 20:35:59 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:35:59 user nova-compute[71654]:     </disk>
Apr 11 20:35:59 user nova-compute[71654]:     <disk type="file" device="cdrom">
Apr 11 20:35:59 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 20:35:59 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.config"/>
Apr 11 20:35:59 user nova-compute[71654]:       <target dev="hda" bus="ide"/>
Apr 11 20:35:59 user nova-compute[71654]:     </disk>
Apr 11 20:35:59 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:35:59 user nova-compute[71654]:       <mac address="fa:16:3e:12:92:b7"/>
Apr 11 20:35:59 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:59 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:35:59 user nova-compute[71654]:       <target dev="tap81fa518b-09"/>
Apr 11 20:35:59 user nova-compute[71654]:     </interface>
Apr 11 20:35:59 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:35:59 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/console.log" append="off"/>
Apr 11 20:35:59 user nova-compute[71654]:     </serial>
Apr 11 20:35:59 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:35:59 user nova-compute[71654]:     <video>
Apr 11 20:35:59 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:35:59 user nova-compute[71654]:     </video>
Apr 11 20:35:59 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:35:59 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:35:59 user nova-compute[71654]:     </rng>
Apr 11 20:35:59 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:35:59 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:35:59 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:35:59 user nova-compute[71654]:     </memballoon>
Apr 11 20:35:59 user nova-compute[71654]:   </devices>
Apr 11 20:35:59 user nova-compute[71654]: </domain>
Apr 11 20:35:59 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG os_vif [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81fa518b-09, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81fa518b-09, col_values=(('external_ids', {'iface-id': '81fa518b-09cd-4072-b9be-2f74d2453d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:92:b7', 'vm-uuid': 'b7d2dbd0-544c-4146-b35c-125eef81c281'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:35:59 user nova-compute[71654]: INFO os_vif [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09')
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No BDM found with device name hda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No VIF found with MAC fa:16:3e:12:92:b7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:35:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Using config drive
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:35:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Creating config drive at /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.config
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz35wk1m1 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz35wk1m1" returned: 0 in 0.069s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:35:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.policy [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a83734398b4ac6bb576381f2557f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284929c90a1e41559d5aa3885cd928b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:35:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Creating image(s)
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "/opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "/opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "/opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "d32af19e53ab112b64f17908c20230269467e2d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:35:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "d32af19e53ab112b64f17908c20230269467e2d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-changed-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Refreshing instance network info cache due to event network-changed-81fa518b-09cd-4072-b9be-2f74d2453d76. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Acquiring lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Acquired lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG nova.network.neutron [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Refreshing network info cache for port 81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.part --force-share --output=json" returned: 0 in 0.182s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG nova.virt.images [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] b5d3e363-bdbc-4f56-9a89-97905d5b374b was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.part /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.part /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.converted" returned: 0 in 0.179s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "d32af19e53ab112b64f17908c20230269467e2d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.919s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Successfully created port: 4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 --force-share --output=json" returned: 0 in 0.197s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "d32af19e53ab112b64f17908c20230269467e2d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "d32af19e53ab112b64f17908c20230269467e2d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 --force-share --output=json" returned: 0 in 0.234s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7,backing_fmt=raw /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7,backing_fmt=raw /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk 1073741824" returned: 0 in 0.090s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "d32af19e53ab112b64f17908c20230269467e2d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 --force-share --output=json" returned: 0 in 0.206s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Cannot resize image /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'migration_context' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Ensure instance console log exists: /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Successfully updated port: 4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:02 user nova-compute[71654]: WARNING nova.compute.manager [req-a96c46fa-74c9-42df-83f4-7bd60d463740 req-5affbe17-696f-443d-9241-1693f99ffc61 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 for instance with vm_state building and task_state spawning.
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updated VIF entry in instance network info cache for port 81fa518b-09cd-4072-b9be-2f74d2453d76. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8f255377-1e84-4d4a-a6ea-d0d858ff3013 req-c344cf52-bf56-4000-88f5-ec5c797bb754 service nova] Releasing lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquired lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-changed-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Refreshing instance network info cache due to event network-changed-4bad185c-c76d-4162-8213-384229da15ca. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Acquiring lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updating instance_info_cache with network_info: [{"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Releasing lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Instance network_info: |[{"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Acquired lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Refreshing network info cache for port 4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Start _get_guest_xml network_info=[{"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:35:49Z,direct_url=<?>,disk_format='qcow2',id=b5d3e363-bdbc-4f56-9a89-97905d5b374b,min_disk=0,min_ram=0,name='',owner='7d2bb923f32e4147b412204492ec15f7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:35:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'b5d3e363-bdbc-4f56-9a89-97905d5b374b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:36:02 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:36:02 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:35:49Z,direct_url=<?>,disk_format='qcow2',id=b5d3e363-bdbc-4f56-9a89-97905d5b374b,min_disk=0,min_ram=0,name='',owner='7d2bb923f32e4147b412204492ec15f7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:35:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:36:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2072587823',display_name='tempest-AttachSCSIVolumeTestJSON-server-2072587823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2072587823',id=8,image_ref='b5d3e363-bdbc-4f56-9a89-97905d5b374b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdT9m+B9YySsnmiLIjHxu4QvlA3mtfywAqzUXZhGrDg1cDaXTY+nvap6IYEGSvC+OLNvbuM7456Nky3u3j5bHxO363IT9g/IDQ0Kx0ome2u3RH00PsRCuHF5RqYu3myFg==',key_name='tempest-keypair-790069645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284929c90a1e41559d5aa3885cd928b4',ramdisk_id='',reservation_id='r-8jha9nmk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b5d3e363-bdbc-4f56-9a89-97905d5b374b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1026499087',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1026499087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a83734398b4ac6bb576381f2557f76',uuid=674a4347-8da2-4455-8e90-0fd358b5f696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Converting VIF {"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'pci_devices' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:36:03 user nova-compute[71654]:   <uuid>674a4347-8da2-4455-8e90-0fd358b5f696</uuid>
Apr 11 20:36:03 user nova-compute[71654]:   <name>instance-00000008</name>
Apr 11 20:36:03 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:36:03 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:36:03 user nova-compute[71654]:   <metadata>
Apr 11 20:36:03 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:36:03 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:36:03 user nova-compute[71654]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2072587823</nova:name>
Apr 11 20:36:03 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:36:02</nova:creationTime>
Apr 11 20:36:03 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:36:03 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:36:03 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:36:03 user nova-compute[71654]:       <nova:owner>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:user uuid="77a83734398b4ac6bb576381f2557f76">tempest-AttachSCSIVolumeTestJSON-1026499087-project-member</nova:user>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:project uuid="284929c90a1e41559d5aa3885cd928b4">tempest-AttachSCSIVolumeTestJSON-1026499087</nova:project>
Apr 11 20:36:03 user nova-compute[71654]:       </nova:owner>
Apr 11 20:36:03 user nova-compute[71654]:       <nova:root type="image" uuid="b5d3e363-bdbc-4f56-9a89-97905d5b374b"/>
Apr 11 20:36:03 user nova-compute[71654]:       <nova:ports>
Apr 11 20:36:03 user nova-compute[71654]:         <nova:port uuid="4bad185c-c76d-4162-8213-384229da15ca">
Apr 11 20:36:03 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 20:36:03 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:03 user nova-compute[71654]:       </nova:ports>
Apr 11 20:36:03 user nova-compute[71654]:     </nova:instance>
Apr 11 20:36:03 user nova-compute[71654]:   </metadata>
Apr 11 20:36:03 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:36:03 user nova-compute[71654]:     <system>
Apr 11 20:36:03 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:36:03 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:36:03 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:36:03 user nova-compute[71654]:       <entry name="serial">674a4347-8da2-4455-8e90-0fd358b5f696</entry>
Apr 11 20:36:03 user nova-compute[71654]:       <entry name="uuid">674a4347-8da2-4455-8e90-0fd358b5f696</entry>
Apr 11 20:36:03 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:36:03 user nova-compute[71654]:     </system>
Apr 11 20:36:03 user nova-compute[71654]:   </sysinfo>
Apr 11 20:36:03 user nova-compute[71654]:   <os>
Apr 11 20:36:03 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:36:03 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:36:03 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:36:03 user nova-compute[71654]:   </os>
Apr 11 20:36:03 user nova-compute[71654]:   <features>
Apr 11 20:36:03 user nova-compute[71654]:     <acpi/>
Apr 11 20:36:03 user nova-compute[71654]:     <apic/>
Apr 11 20:36:03 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:36:03 user nova-compute[71654]:   </features>
Apr 11 20:36:03 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:36:03 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:36:03 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:36:03 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:36:03 user nova-compute[71654]:   </clock>
Apr 11 20:36:03 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:36:03 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:36:03 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:36:03 user nova-compute[71654]:   </cpu>
Apr 11 20:36:03 user nova-compute[71654]:   <devices>
Apr 11 20:36:03 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:36:03 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:36:03 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk"/>
Apr 11 20:36:03 user nova-compute[71654]:       <target dev="sda" bus="scsi"/>
Apr 11 20:36:03 user nova-compute[71654]:       <address type="drive" controller="0" unit="0"/>
Apr 11 20:36:03 user nova-compute[71654]:     </disk>
Apr 11 20:36:03 user nova-compute[71654]:     <disk type="file" device="cdrom">
Apr 11 20:36:03 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 20:36:03 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.config"/>
Apr 11 20:36:03 user nova-compute[71654]:       <target dev="sdb" bus="scsi"/>
Apr 11 20:36:03 user nova-compute[71654]:       <address type="drive" controller="0" unit="1"/>
Apr 11 20:36:03 user nova-compute[71654]:     </disk>
Apr 11 20:36:03 user nova-compute[71654]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 20:36:03 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:03 user nova-compute[71654]:       <mac address="fa:16:3e:8d:ef:2d"/>
Apr 11 20:36:03 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:03 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:03 user nova-compute[71654]:       <target dev="tap4bad185c-c7"/>
Apr 11 20:36:03 user nova-compute[71654]:     </interface>
Apr 11 20:36:03 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:36:03 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/console.log" append="off"/>
Apr 11 20:36:03 user nova-compute[71654]:     </serial>
Apr 11 20:36:03 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:36:03 user nova-compute[71654]:     <video>
Apr 11 20:36:03 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:03 user nova-compute[71654]:     </video>
Apr 11 20:36:03 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:36:03 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:36:03 user nova-compute[71654]:     </rng>
Apr 11 20:36:03 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:36:03 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:36:03 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:36:03 user nova-compute[71654]:     </memballoon>
Apr 11 20:36:03 user nova-compute[71654]:   </devices>
Apr 11 20:36:03 user nova-compute[71654]: </domain>
Apr 11 20:36:03 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2072587823',display_name='tempest-AttachSCSIVolumeTestJSON-server-2072587823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2072587823',id=8,image_ref='b5d3e363-bdbc-4f56-9a89-97905d5b374b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdT9m+B9YySsnmiLIjHxu4QvlA3mtfywAqzUXZhGrDg1cDaXTY+nvap6IYEGSvC+OLNvbuM7456Nky3u3j5bHxO363IT9g/IDQ0Kx0ome2u3RH00PsRCuHF5RqYu3myFg==',key_name='tempest-keypair-790069645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284929c90a1e41559d5aa3885cd928b4',ramdisk_id='',reservation_id='r-8jha9nmk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b5d3e363-bdbc-4f56-9a89-97905d5b374b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1026499087',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1026499087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a83734398b4ac6bb576381f2557f76',uuid=674a4347-8da2-4455-8e90-0fd358b5f696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Converting VIF {"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG os_vif [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bad185c-c7, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bad185c-c7, col_values=(('external_ids', {'iface-id': '4bad185c-c76d-4162-8213-384229da15ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:ef:2d', 'vm-uuid': '674a4347-8da2-4455-8e90-0fd358b5f696'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:03 user nova-compute[71654]: INFO os_vif [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7')
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No BDM found with device name sda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No VIF found with MAC fa:16:3e:8d:ef:2d, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:36:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Using config drive
Apr 11 20:36:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Creating config drive at /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.config
Apr 11 20:36:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_9m5e5hp {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_9m5e5hp" returned: 0 in 0.065s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updated VIF entry in instance network info cache for port 4bad185c-c76d-4162-8213-384229da15ca. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updating instance_info_cache with network_info: [{"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-77cb0e8d-fc76-48f7-b5d5-e18b7ab55438 req-5fbbd998-db9f-436a-8c87-90bcecf05566 service nova] Releasing lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245364.0484989, b7d2dbd0-544c-4146-b35c-125eef81c281 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] VM Resumed (Lifecycle Event)
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Instance spawned successfully.
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245364.0679595, b7d2dbd0-544c-4146-b35c-125eef81c281 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] VM Started (Lifecycle Event)
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:04 user nova-compute[71654]: WARNING nova.compute.manager [req-55fa737a-b913-4ec8-acc3-fecdabf4ac89 req-dd107b88-6cd1-4abc-8c2d-8bd5c64e37f5 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 for instance with vm_state building and task_state spawning.
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Took 9.38 seconds to spawn the instance on the hypervisor.
Apr 11 20:36:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:04 user nova-compute[71654]: INFO nova.compute.manager [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Took 10.70 seconds to build instance.
Apr 11 20:36:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-de1bd690-7430-4c36-9932-91070c10d8e4 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.030s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] No waiting events found dispatching network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:06 user nova-compute[71654]: WARNING nova.compute.manager [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received unexpected event network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca for instance with vm_state building and task_state spawning.
Apr 11 20:36:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] No waiting events found dispatching network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:06 user nova-compute[71654]: WARNING nova.compute.manager [req-db791459-6a24-421f-9a28-50d7c49aaf35 req-c167d499-39c8-42ec-bf2b-cc16662b42bf service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received unexpected event network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca for instance with vm_state building and task_state spawning.
Apr 11 20:36:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245367.730845, 674a4347-8da2-4455-8e90-0fd358b5f696 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:36:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] VM Resumed (Lifecycle Event)
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Instance spawned successfully.
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245367.7398713, 674a4347-8da2-4455-8e90-0fd358b5f696 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:36:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] VM Started (Lifecycle Event)
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:36:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:36:07 user nova-compute[71654]: INFO nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Took 8.18 seconds to spawn the instance on the hypervisor.
Apr 11 20:36:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:08 user nova-compute[71654]: INFO nova.compute.manager [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Took 9.33 seconds to build instance.
Apr 11 20:36:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a10a3ac6-b915-4119-916e-b51c74967486 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.571s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:09 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:10 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "531a0692-eac9-4ac7-95dd-abb138512f30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:36:11 user nova-compute[71654]: INFO nova.compute.claims [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Claim successful on node user
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:36:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:12 user nova-compute[71654]: INFO nova.virt.block_device [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Booting with volume 5b934599-7ca8-4454-92c2-a16987271127 at /dev/vda
Apr 11 20:36:12 user nova-compute[71654]: DEBUG nova.policy [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5d98b3ceee842b08adb37e62e68436e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa968f4c38c40719e6169250097c718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG os_brick.utils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:36:12 user nova-compute[71654]: INFO oslo.privsep.daemon [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6_jmpryi/privsep.sock']
Apr 11 20:36:12 user sudo[81789]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6_jmpryi/privsep.sock
Apr 11 20:36:12 user sudo[81789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully created port: e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully created port: 532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:36:14 user sudo[81789]: pam_unix(sudo:session): session closed for user root
Apr 11 20:36:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:36:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=26.752544403076172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:14 user nova-compute[71654]: INFO oslo.privsep.daemon [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Spawned new privsep daemon via rootwrap
Apr 11 20:36:14 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 20:36:14 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 20:36:14 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 20:36:14 user nova-compute[71654]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81862
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed34b4f-2445-4bf5-8db8-7903a9dc576c]: (2,) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[80191d43-fcb4-4145-a26c-3fbdda038933]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:14 user nova-compute[71654]: WARNING os_brick.initiator.connectors.nvmeof [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4bca42-0d2a-4836-8fad-f6c9fa602e31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d040b-127e-464f-b2d5-ac221eed3a96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3eba57-632e-4f7e-bbdb-47d747fd74dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:36:14 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:36:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68d244-66f9-4778-b2ca-f9b6fd3040f6]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG os_brick.utils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== get_connector_properties: return (2076ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating existing volume attachment record: db4bcc52-7fc7-4861-a45f-6be0c28ed6f7 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 7831232f-c75e-4403-919d-bc2d69b659e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b7d2dbd0-544c-4146-b35c-125eef81c281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 674a4347-8da2-4455-8e90-0fd358b5f696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 531a0692-eac9-4ac7-95dd-abb138512f30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:36:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully created port: 58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:36:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.943s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully created port: 2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Skipping network cache update for instance because it is Building. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 7831232f-c75e-4403-919d-bc2d69b659e5 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:36:16 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully created port: c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:36:17 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updating instance_info_cache with network_info: [{"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-7831232f-c75e-4403-919d-bc2d69b659e5" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:36:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:36:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:36:17 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-e31567ff-e573-4ed5-a006-bd58e4910906. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d004f94b-d43e-4302-8f6d-1a9535f76465 req-4c9fcd0c-e077-457f-8812-f488bda0be52 service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:18 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: 1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:19 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: 33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port 1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:20 user nova-compute[71654]: INFO nova.virt.block_device [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Booting with volume 97768c05-bc64-4bf6-83ae-4350d75b7320 at /dev/vdb
Apr 11 20:36:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c52a03c-7341-450c-bc4b-6bc19b52d128]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d7d50-ef41-4415-9d9b-f4737b089f20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c15d1f-626a-42ea-9d4a-f7679f207479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc1def-af28-4ffc-8819-1068be27cc09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:36:20 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc0abe-5d5f-4005-9f25-530f6416a288]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating existing volume attachment record: 735e0734-9698-4aed-b155-16a9df49f3ae {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port 33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: 532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c3b6d757-03a2-452a-a81b-e8b185f0814a req-22d29a5a-07b2-4f49-a179-c90a5d67451f service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: 58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-532c5436-45ba-4503-a774-4fa206ce6f73. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port 532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: 2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-58994cba-fc42-41f3-9e7c-9d2c4048ba15. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port 58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4598330-68ab-438e-ba00-e5cae88c6d6e req-ffecd557-df14-47c2-9e01-7fb1507704f7 service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Successfully updated port: c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-2279246f-00a6-4589-b12c-ca5ab19d54a7. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:24 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:36:25 user nova-compute[71654]: INFO nova.virt.block_device [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Booting with volume ca36a125-7c79-4bf4-8c28-9d1b798dceba at /dev/vdc
Apr 11 20:36:25 user nova-compute[71654]: DEBUG os_brick.utils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7c4be2-481b-4ce1-a23a-05e04deff067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a3ff2-6407-4d85-9bb9-989ce3abd702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e9c13-a5c8-40e0-8d6a-3c392ae93bee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e38fe29-e321-481c-bb41-2753a3e5d44a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:36:25 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:36:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[79735ede-4f7b-484e-947f-a83e88015c6d]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG os_brick.utils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:36:25 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating existing volume attachment record: 673ea842-446a-45af-a9a3-53d495ec6ff7 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:36:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:26 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance network_info: |[{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:36:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:26 user nova-compute[71654]: DEBUG nova.network.neutron [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port 2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updated VIF entry in instance network info cache for port 2279246f-00a6-4589-b12c-ca5ab19d54a7. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-c8d0aab1-4380-41a7-aeb6-3222168c5c52. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updated VIF entry in instance network info cache for port c8d0aab1-4380-41a7-aeb6-3222168c5c52. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:36:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6245a7c0-08a7-4b74-b563-b499d68457bf req-e82c4309-2109-486d-8267-7eab2cfe052a service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:36:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:36:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Creating image(s)
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Ensure instance console log exists: /opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Start _get_guest_xml network_info=[{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzjBQWbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '531a0692-eac9-4ac7-95dd-abb138512f30', 'attached_at': '', 'detached_at': '', 'volume_id': '5b934599-7ca8-4454-92c2-a16987271127', 'serial': '5b934599-7ca8-4454-92c2-a16987271127'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'db4bcc52-7fc7-4861-a45f-6be0c28ed6f7', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuiTFgOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '531a0692-eac9-4ac7-95dd-abb138512f30', 'attached_at': '', 'detached_at': '', 'volume_id': '97768c05-bc64-4bf6-83ae-4350d75b7320', 'serial': '97768c05-bc64-4bf6-83ae-4350d75b7320'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '735e0734-9698-4aed-b155-16a9df49f3ae', 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXEdfJPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '531a0692-eac9-4ac7-95dd-abb138512f30', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca36a125-7c79-4bf4-8c28-9d1b798dceba', 'serial': 'ca36a125-7c79-4bf4-8c28-9d1b798dceba'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '673ea842-446a-45af-a9a3-53d495ec6ff7', 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:36:29 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:36:29 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connector [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Factory for ISCSI on None {{(pid=71654) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzjBQWbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:36:29 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:36:29 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:36:29 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847ab19-240b-4d29-9d8d-0fd8299a2cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:36:29 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df4c65-0722-44ca-8a69-cc326b2baae8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127] added
Apr 11 20:36:29 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[291a3253-d796-4fd1-8b21-7e319cec3717]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[17270e8e-d9c2-49a7-9469-9f37998c2a0b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzjBQWbk {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzjBQWbk" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7059a6d-7fe1-47bf-97b7-d6502194a9ea]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AzjBQWbk'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[03098f30-3293-4e46-9cf6-6ea5f00be241]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc85e0-df66-4c45-b585-d68446166fcd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 20:36:30 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 20:36:30 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:36:30 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 20:36:30 user nova-compute[71654]: 
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c233f7d-e3c2-46ca-b925-4d0d7c2f4e88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260]
Apr 11 20:36:30 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260] successful.
Apr 11 20:36:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3683c-72fb-4f62-90ea-63fc7f3442fb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee390409-b4ab-469e-954f-aa816707a96a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b1cba-5960-48c1-8f4e-07aaab6cc54c]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:36:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzjBQWbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23436316635643966', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436316635643966', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuiTFgOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:36:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:36:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:36:31 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c534e1-440c-4d86-8556-6ea3a80cf9e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:36:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[103db50e-f3aa-44ee-a265-8ee9bad8f20a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320] added
Apr 11 20:36:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ae5d2-47d2-4d47-b818-a669353a3a66]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78828d5-e0c6-42cd-85d7-6a38f50c0a18]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuiTFgOE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuiTFgOE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7cf384-fa72-407b-b088-a158eb569314]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cuiTFgOE'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2063243-d094-4be3-bdef-fbcf1889fc76]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[481b1268-94b0-4412-bfe9-0f506c0d0b17]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[84140fe4-275f-4d0d-be54-940c435e8396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260]
Apr 11 20:36:31 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260] successful.
Apr 11 20:36:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1c9a92-2f3f-40c8-8dcf-ab6e3d44d452]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aca1967-6ce2-4d04-ab06-f3ca4864bf7a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:31 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:36:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:31 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:36:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[200dd3b2-7eaf-4d11-b712-7a5eb6ff17ce]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:36:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuiTFgOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23931623366376137', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931623366376137', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXEdfJPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:36:32 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:36:32 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:36:32 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e8e57-1708-40e1-bfe0-3c84958d4839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:36:32 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04f0c99-6939-42ea-a2da-c2ecadcdba06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba] added
Apr 11 20:36:32 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c84921-7c4d-4bfd-acd4-091312a9ab9f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb1239-7b3a-40ad-a1aa-5ff121102fce]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kXEdfJPU {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kXEdfJPU" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3159c9-3d09-4c1a-8877-c1054b54f5cd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kXEdfJPU'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[688d6652-edc4-46c8-835b-ab4207faca3e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb09f7-e848-4dba-a6a6-f5d79501002a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:32 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:36:32 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:32 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:36:32 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:36:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d228c3-2efc-4f09-bd06-ae802de0257e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260]
Apr 11 20:36:33 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260] successful.
Apr 11 20:36:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[569d8641-46d9-474f-aa4d-0e652241d0ca]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a618d2-621e-45a4-b76d-e7e87b87d6a0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:33 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:36:33 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:36:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:36:33 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:36:33 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:36:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d5902e-97c4-4813-975b-b6c8bc9c6471]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:36:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXEdfJPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23730353461383364', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353461383364', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lazy-loading 'pci_devices' on Instance uuid 531a0692-eac9-4ac7-95dd-abb138512f30 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:36:34 user nova-compute[71654]:   <uuid>531a0692-eac9-4ac7-95dd-abb138512f30</uuid>
Apr 11 20:36:34 user nova-compute[71654]:   <name>instance-00000009</name>
Apr 11 20:36:34 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:36:34 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:36:34 user nova-compute[71654]:   <metadata>
Apr 11 20:36:34 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:36:34 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:36:34 user nova-compute[71654]:       <nova:name>tempest-device-tagging-server-27898241</nova:name>
Apr 11 20:36:34 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:36:29</nova:creationTime>
Apr 11 20:36:34 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:36:34 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:36:34 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:36:34 user nova-compute[71654]:       <nova:owner>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:user uuid="d5d98b3ceee842b08adb37e62e68436e">tempest-TaggedBootDevicesTest-1812283911-project-member</nova:user>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:project uuid="caa968f4c38c40719e6169250097c718">tempest-TaggedBootDevicesTest-1812283911</nova:project>
Apr 11 20:36:34 user nova-compute[71654]:       </nova:owner>
Apr 11 20:36:34 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:36:34 user nova-compute[71654]:       <nova:ports>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="e31567ff-e573-4ed5-a006-bd58e4910906">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="1bb7820c-fce7-4d0d-8d4c-4d506f0db38e">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="33b1d7c0-166a-4aa9-92b4-5b7d16637dc2">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="532c5436-45ba-4503-a774-4fa206ce6f73">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="58994cba-fc42-41f3-9e7c-9d2c4048ba15">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="2279246f-00a6-4589-b12c-ca5ab19d54a7">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:         <nova:port uuid="c8d0aab1-4380-41a7-aeb6-3222168c5c52">
Apr 11 20:36:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 20:36:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:36:34 user nova-compute[71654]:       </nova:ports>
Apr 11 20:36:34 user nova-compute[71654]:     </nova:instance>
Apr 11 20:36:34 user nova-compute[71654]:   </metadata>
Apr 11 20:36:34 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:36:34 user nova-compute[71654]:     <system>
Apr 11 20:36:34 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:36:34 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:36:34 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:36:34 user nova-compute[71654]:       <entry name="serial">531a0692-eac9-4ac7-95dd-abb138512f30</entry>
Apr 11 20:36:34 user nova-compute[71654]:       <entry name="uuid">531a0692-eac9-4ac7-95dd-abb138512f30</entry>
Apr 11 20:36:34 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:36:34 user nova-compute[71654]:     </system>
Apr 11 20:36:34 user nova-compute[71654]:   </sysinfo>
Apr 11 20:36:34 user nova-compute[71654]:   <os>
Apr 11 20:36:34 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:36:34 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:36:34 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:36:34 user nova-compute[71654]:   </os>
Apr 11 20:36:34 user nova-compute[71654]:   <features>
Apr 11 20:36:34 user nova-compute[71654]:     <acpi/>
Apr 11 20:36:34 user nova-compute[71654]:     <apic/>
Apr 11 20:36:34 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:36:34 user nova-compute[71654]:   </features>
Apr 11 20:36:34 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:36:34 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:36:34 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:36:34 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:36:34 user nova-compute[71654]:   </clock>
Apr 11 20:36:34 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:36:34 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:36:34 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:36:34 user nova-compute[71654]:   </cpu>
Apr 11 20:36:34 user nova-compute[71654]:   <devices>
Apr 11 20:36:34 user nova-compute[71654]:     <disk type="file" device="cdrom">
Apr 11 20:36:34 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 20:36:34 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30/disk.config"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="hda" bus="ide"/>
Apr 11 20:36:34 user nova-compute[71654]:     </disk>
Apr 11 20:36:34 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:36:34 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:36:34 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <serial>5b934599-7ca8-4454-92c2-a16987271127</serial>
Apr 11 20:36:34 user nova-compute[71654]:     </disk>
Apr 11 20:36:34 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:36:34 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:36:34 user nova-compute[71654]:       <source dev="/dev/sdc"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <serial>97768c05-bc64-4bf6-83ae-4350d75b7320</serial>
Apr 11 20:36:34 user nova-compute[71654]:     </disk>
Apr 11 20:36:34 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:36:34 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:36:34 user nova-compute[71654]:       <source dev="/dev/sdd"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="vdc" bus="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <serial>ca36a125-7c79-4bf4-8c28-9d1b798dceba</serial>
Apr 11 20:36:34 user nova-compute[71654]:     </disk>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:b9:80:21"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tape31567ff-e5"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:0f:b0:ca"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tap1bb7820c-fc"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:50:dd:2f"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tap33b1d7c0-16"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:f4:55:46"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tap532c5436-45"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:41:08:12"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tap58994cba-fc"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:dd:9c:3c"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tap2279246f-00"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:36:34 user nova-compute[71654]:       <mac address="fa:16:3e:22:ff:a0"/>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:36:34 user nova-compute[71654]:       <target dev="tapc8d0aab1-43"/>
Apr 11 20:36:34 user nova-compute[71654]:     </interface>
Apr 11 20:36:34 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:36:34 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30/console.log" append="off"/>
Apr 11 20:36:34 user nova-compute[71654]:     </serial>
Apr 11 20:36:34 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:36:34 user nova-compute[71654]:     <video>
Apr 11 20:36:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:36:34 user nova-compute[71654]:     </video>
Apr 11 20:36:34 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:36:34 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:36:34 user nova-compute[71654]:     </rng>
Apr 11 20:36:34 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:36:34 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:36:34 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:36:34 user nova-compute[71654]:     </memballoon>
Apr 11 20:36:34 user nova-compute[71654]:   </devices>
Apr 11 20:36:34 user nova-compute[71654]: </domain>
Apr 11 20:36:34 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape31567ff-e5, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape31567ff-e5, col_values=(('external_ids', {'iface-id': 'e31567ff-e573-4ed5-a006-bd58e4910906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:80:21', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb7820c-fc, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bb7820c-fc, col_values=(('external_ids', {'iface-id': '1bb7820c-fce7-4d0d-8d4c-4d506f0db38e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:b0:ca', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33b1d7c0-16, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33b1d7c0-16, col_values=(('external_ids', {'iface-id': '33b1d7c0-166a-4aa9-92b4-5b7d16637dc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:dd:2f', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap532c5436-45, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap532c5436-45, col_values=(('external_ids', {'iface-id': '532c5436-45ba-4503-a774-4fa206ce6f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:55:46', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58994cba-fc, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58994cba-fc, col_values=(('external_ids', {'iface-id': '58994cba-fc42-41f3-9e7c-9d2c4048ba15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:08:12', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2279246f-00, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2279246f-00, col_values=(('external_ids', {'iface-id': '2279246f-00a6-4589-b12c-ca5ab19d54a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:9c:3c', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8d0aab1-43, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8d0aab1-43, col_values=(('external_ids', {'iface-id': 'c8d0aab1-4380-41a7-aeb6-3222168c5c52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ff:a0', 'vm-uuid': '531a0692-eac9-4ac7-95dd-abb138512f30'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:34 user nova-compute[71654]: INFO os_vif [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43')
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] No BDM found with device name hda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] No VIF found with MAC fa:16:3e:b9:80:21, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] No VIF found with MAC fa:16:3e:41:08:12, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:36:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Using config drive
Apr 11 20:36:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Creating config drive at /opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30/disk.config
Apr 11 20:36:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8jlmkmva {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:36:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8jlmkmva" returned: 0 in 0.062s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:36 user nova-compute[71654]: WARNING nova.compute.manager [req-dbd2b345-ce66-4904-92c3-338d5c723228 req-6080957b-cca6-4985-a4ec-cdd289ffbc07 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 for instance with vm_state building and task_state spawning.
Apr 11 20:36:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:37 user nova-compute[71654]: WARNING nova.compute.manager [req-05b6b21b-e694-4499-b18c-fe4206480ea3 req-2de6da47-2791-47b1-be71-348b42a68f26 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance with vm_state building and task_state spawning.
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:37 user nova-compute[71654]: WARNING nova.compute.manager [req-47e70ac8-877a-4deb-a4ee-35aab8a7f4b0 req-f302b3ce-e9a4-4053-9343-ed25ee29d481 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance with vm_state building and task_state spawning.
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:38 user nova-compute[71654]: WARNING nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 for instance with vm_state building and task_state spawning.
Apr 11 20:36:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:38 user nova-compute[71654]: WARNING nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 for instance with vm_state building and task_state spawning.
Apr 11 20:36:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:38 user nova-compute[71654]: WARNING nova.compute.manager [req-5a9535f0-d91d-44c8-845e-8c38596e9eec req-1f27c6f8-f929-4c2b-a26c-0b4592559e42 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 for instance with vm_state building and task_state spawning.
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-cf55c442-e6be-4224-b208-fae786eefc9e req-1860bba9-0b5e-4ed9-a5db-71b7ca223728 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:36:39 user nova-compute[71654]: WARNING nova.compute.manager [req-bd42ac9d-3f64-4f82-88e4-fecc6865c2e0 req-d7908d94-84fc-429a-9311-a70ffa90d565 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance with vm_state building and task_state spawning.
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245400.5809715, 531a0692-eac9-4ac7-95dd-abb138512f30 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] VM Resumed (Lifecycle Event)
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance spawned successfully.
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245400.586372, 531a0692-eac9-4ac7-95dd-abb138512f30 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] VM Started (Lifecycle Event)
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Took 10.87 seconds to spawn the instance on the hypervisor.
Apr 11 20:36:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:36:40 user nova-compute[71654]: INFO nova.compute.manager [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Took 29.04 seconds to build instance.
Apr 11 20:36:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1afac62f-fe97-4e4b-9b65-3e9f5545761b tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "531a0692-eac9-4ac7-95dd-abb138512f30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.192s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:36:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:36:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:07 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:11 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:12 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lazy-loading 'flavor' on Instance uuid 7831232f-c75e-4403-919d-bc2d69b659e5 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:13 user nova-compute[71654]: INFO nova.compute.manager [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Attaching volume 1fded504-789e-4265-a6f5-8b737bfb7630 to /dev/vdb
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a54c0f-bd2a-4e2d-a355-d584e17e4b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d2e63-cc3e-48cc-b9b2-b3b5c597ac03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[98093b18-2dce-4ee2-8b34-fad9df31bc1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[80134ff5-d060-4d6c-8a29-2a0808e1f2b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:13 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:37:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b77ac76-9f05-4613-aa54-c511d8d70add]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:13 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updating existing volume attachment record: 2584e1f0-9bcf-49c1-9c10-85db9c0ddb55 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:16 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:37:16 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7751MB free_disk=26.697509765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 7831232f-c75e-4403-919d-bc2d69b659e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b7d2dbd0-544c-4146-b35c-125eef81c281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 674a4347-8da2-4455-8e90-0fd358b5f696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 531a0692-eac9-4ac7-95dd-abb138512f30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:37:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing instance network info cache due to event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPAYWTaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:18 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748649d-6782-45cb-a51d-a562362d1ee3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:37:18 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8045773-d64e-425a-bd80-b8e97f8a656e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630] added
Apr 11 20:37:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c02a7-4ff7-45c7-8021-c4b977cc2463]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee82d97-7556-4480-836c-1c40e13178fb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPAYWTaO {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fPAYWTaO" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff9e2a-52bf-4ee9-ac8d-648b7d5e76be]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fPAYWTaO'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9ac343-eb97-43bb-8d3b-b3ca40d158c8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee642e-c7b2-49af-bc60-a2405cab4c3c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f963a3c6-7aa4-4a9f-910d-0f7338555b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260]
Apr 11 20:37:18 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231e700-34fe-4562-9489-d37f53af4d9c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5392578-c4e9-43f9-8f30-b7df01966910]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:18 user nova-compute[71654]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 (non-flash)
Apr 11 20:37:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updated VIF entry in instance network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa372d64-7e9b-496e-bcf6-44bb82fd1f1a]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3d0ad315-0961-4126-a6a2-14ea482bf7d8 req-19e411e3-fefe-4e30-aec6-cc9b3df4367d service nova] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPAYWTaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26361666630376330', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361666630376330', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lazy-loading 'flavor' on Instance uuid 7831232f-c75e-4403-919d-bc2d69b659e5 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:37:19 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:19 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:37:19 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:19 user nova-compute[71654]:   <serial>1fded504-789e-4265-a6f5-8b737bfb7630</serial>
Apr 11 20:37:19 user nova-compute[71654]: </disk>
Apr 11 20:37:19 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-changed-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Refreshing instance network info cache due to event network-changed-21864ca9-0ae0-4591-a5bc-fac2428743cb. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:19 user nova-compute[71654]: DEBUG nova.network.neutron [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Refreshing network info cache for port 21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] No VIF found with MAC fa:16:3e:08:09:3e, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64d0eabc-9386-451b-a3e3-e23cbefc7747 tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.664s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updated VIF entry in instance network info cache for port 21864ca9-0ae0-4591-a5bc-fac2428743cb. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-59a0de95-bc09-4fc7-a70f-56c9149168ec req-fec5d4a5-dd21-49da-91a2-4279f6e94423 service nova] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:21 user nova-compute[71654]: INFO nova.compute.manager [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Shelving
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-unplugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-unplugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:37:21 user nova-compute[71654]: WARNING nova.compute.manager [req-dcf8df40-5031-4b40-96c2-9bd1d60bd35a req-4b9a2dea-4a51-410e-aa7a-505c0eeb8508 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-unplugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state active and task_state shelving.
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:21 user nova-compute[71654]: INFO nova.compute.manager [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Terminating instance
Apr 11 20:37:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:21 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance destroyed successfully.
Apr 11 20:37:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Beginning cold snapshot process
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk /opt/stack/data/nova/instances/snapshots/tmpfpytne5g/9bee44ecdda44c249b9dd2350dc0eb17 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Instance destroyed successfully.
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lazy-loading 'resources' on Instance uuid 7831232f-c75e-4403-919d-bc2d69b659e5 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1204998430',display_name='tempest-DeleteServersTestJSON-server-1204998430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1204998430',id=1,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0987ef9e9d6848ce9936af3567da53a2',ramdisk_id='',reservation_id='r-x2k9r1s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1287076322',owner_user_name='tempest-DeleteServersTestJSON-1287076322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:35:39Z,user_data=None,user_id='febd86b9e597436dae2b8c702aff1e8e',uuid=7831232f-c75e-4403-919d-bc2d69b659e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Converting VIF {"id": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "address": "fa:16:3e:08:09:3e", "network": {"id": "85e1d37e-b115-421f-9534-37865673ff59", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1433592558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0987ef9e9d6848ce9936af3567da53a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e9edf73-7a", "ovs_interfaceid": "9e9edf73-7af6-41ad-9e04-9528f3dde81a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_vif [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e9edf73-7a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:22 user nova-compute[71654]: INFO os_vif [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:09:3e,bridge_name='br-int',has_traffic_filtering=True,id=9e9edf73-7af6-41ad-9e04-9528f3dde81a,network=Network(85e1d37e-b115-421f-9534-37865673ff59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e9edf73-7a')
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fPAYWTaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:22 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d70e810-92d4-44e6-a76f-160655e7e80d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:37:22 user nova-compute[71654]: No targets found.
Apr 11 20:37:22 user nova-compute[71654]: iSNS:
Apr 11 20:37:22 user nova-compute[71654]: No targets found.
Apr 11 20:37:22 user nova-compute[71654]: STATIC:
Apr 11 20:37:22 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127
Apr 11 20:37:22 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:22 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:22 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:37:22 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:22 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:22 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630
Apr 11 20:37:22 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:22 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:22 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:37:22 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:22 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:22 user nova-compute[71654]: FIRMWARE:
Apr 11 20:37:22 user nova-compute[71654]: No targets found.
Apr 11 20:37:22 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:37:22 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:37:22 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a02441-6bea-490b-b2ce-ed4daaf7955d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[322861bc-237d-45af-b1d0-da8136762367]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:22 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:22 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:22 user nova-compute[71654]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 (non-flash)
Apr 11 20:37:22 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:22 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:22 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:22 user nova-compute[71654]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 (non-flash)
Apr 11 20:37:22 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb40301510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b45795-e54f-4fc1-8ebd-3d6ea3f76aae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c4ee3-eb8d-4504-a3bd-0e7cfec116da]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ca95e1-e43c-4fb9-bd54-68d280325708]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e03461-5d81-44dd-9e4c-5db06e5563f0]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11d8629-b047-4355-bd87-528f5eb4c34e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f594c0ac-0c3d-483f-8070-f0e2a2400e6d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260]
Apr 11 20:37:22 user nova-compute[71654]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:22 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fded504-789e-4265-a6f5-8b737bfb7630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fabde1-ee00-4b01-989d-0e0392786ab2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] <== disconnect_volume: return (343ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:37:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Deleting instance files /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5_del
Apr 11 20:37:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Deletion of /opt/stack/data/nova/instances/7831232f-c75e-4403-919d-bc2d69b659e5_del complete
Apr 11 20:37:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk /opt/stack/data/nova/instances/snapshots/tmpfpytne5g/9bee44ecdda44c249b9dd2350dc0eb17" returned: 0 in 0.546s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Snapshot extracted, beginning image upload
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71654) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 20:37:23 user nova-compute[71654]: INFO nova.virt.libvirt.host [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] UEFI support detected
Apr 11 20:37:23 user nova-compute[71654]: INFO nova.compute.manager [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Took 1.44 seconds to destroy the instance on the hypervisor.
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:37:23 user nova-compute[71654]: WARNING nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-vif-unplugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] No waiting events found dispatching network-vif-unplugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-vif-unplugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Acquiring lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] Lock "7831232f-c75e-4403-919d-bc2d69b659e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] No waiting events found dispatching network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:37:23 user nova-compute[71654]: WARNING nova.compute.manager [req-2384504e-8ec7-48ed-b4d6-e0dee31bf272 req-fea3d717-caae-495f-b9b5-9c2ac46bd8c6 service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received unexpected event network-vif-plugged-9e9edf73-7af6-41ad-9e04-9528f3dde81a for instance with vm_state active and task_state deleting.
Apr 11 20:37:24 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:24 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Took 1.06 seconds to deallocate network for instance.
Apr 11 20:37:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-fba2e91d-b6a8-4f8e-be72-337a67d32c46 req-3a116d51-dc87-45fa-9262-201e76b8b63c service nova] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Received event network-vif-deleted-9e9edf73-7af6-41ad-9e04-9528f3dde81a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:24 user nova-compute[71654]: INFO nova.compute.manager [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 20:37:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Snapshot image upload complete
Apr 11 20:37:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:37:25 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Deleted allocations for instance 7831232f-c75e-4403-919d-bc2d69b659e5
Apr 11 20:37:25 user nova-compute[71654]: INFO nova.compute.manager [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Shelve offloading
Apr 11 20:37:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance destroyed successfully.
Apr 11 20:37:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9c915bc-58be-4561-873c-10eda85d931f tempest-DeleteServersTestJSON-1287076322 tempest-DeleteServersTestJSON-1287076322-project-member] Lock "7831232f-c75e-4403-919d-bc2d69b659e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.800s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing instance network info cache due to event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.network.neutron [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance destroyed successfully.
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'resources' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482156858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482156858',id=2,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR9qqL3LAGODqH+Z+1EkQCpgM8apAvzyB/jSy1MSWBRkUN4MsKV/vwwKd/cnP2giBycseEQJi5Z0VeYGnUBpd0fbzhscsD5KYv7mXFpxsVb4OZ8zQ+33MPkGmZFDcxTSg==',key_name='tempest-keypair-1950690295',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-y79rwl52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member',shelved_at='2023-04-11T20:37:25.288488',shelved_host='user',shelved_image_id='49564bf4-2bb0-43e5-a4d1-13c22447ab58'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=534b82fe-0c07-46dd-bb21-66ad7f6b1397,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG os_vif [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2d4c99b-9f, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing instance network info cache due to event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.network.neutron [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:26 user nova-compute[71654]: INFO os_vif [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f')
Apr 11 20:37:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Deleting instance files /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397_del
Apr 11 20:37:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Deletion of /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397_del complete
Apr 11 20:37:26 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Deleted allocations for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397
Apr 11 20:37:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'numa_topology' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.network.neutron [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updated VIF entry in instance network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:26 user nova-compute[71654]: DEBUG nova.network.neutron [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9efc1b85-e6cf-47fe-a68a-881e3e527382 req-4b4955ca-3db2-4aae-9c97-469dc011b6cd service nova] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updated VIF entry in instance network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8f975b2a-2f32-4097-b61b-416492a09134 req-bd87be22-4a16-4f66-aa2f-ca227e5e2e9a service nova] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3dc3c805-54c7-4c3d-bc1b-db035825ded4 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.966s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:37:27 user nova-compute[71654]: INFO nova.compute.manager [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] instance snapshotting
Apr 11 20:37:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Beginning live snapshot process
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc0bwx15q/c0d9d49bc0e74c31bf1b897dfc699592.delta 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc0bwx15q/c0d9d49bc0e74c31bf1b897dfc699592.delta 1073741824" returned: 0 in 0.049s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:28 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 20:37:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] COPY block job progress, current cursor: 65536 final cursor: 43778048 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 20:37:29 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:37:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc0bwx15q/c0d9d49bc0e74c31bf1b897dfc699592.delta /opt/stack/data/nova/instances/snapshots/tmpc0bwx15q/c0d9d49bc0e74c31bf1b897dfc699592 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc0bwx15q/c0d9d49bc0e74c31bf1b897dfc699592.delta /opt/stack/data/nova/instances/snapshots/tmpc0bwx15q/c0d9d49bc0e74c31bf1b897dfc699592" returned: 0 in 0.325s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Snapshot extracted, beginning image upload
Apr 11 20:37:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:32 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Snapshot image upload complete
Apr 11 20:37:32 user nova-compute[71654]: INFO nova.compute.manager [None req-694ceea9-d7e5-46f6-a6f0-c4571e073df2 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Took 4.60 seconds to snapshot the instance on the hypervisor.
Apr 11 20:37:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-changed-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Refreshing instance network info cache due to event network-changed-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Acquiring lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Acquired lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Refreshing network info cache for port 4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:34 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'flavor' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:35 user nova-compute[71654]: INFO nova.compute.manager [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Attaching volume 54c1df9d-22e1-4a3b-a9f9-8200f8463170 to /dev/vdb
Apr 11 20:37:35 user nova-compute[71654]: DEBUG os_brick.utils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e398203-a4cc-41c4-a8f8-6eef06699ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0d49d-4f2f-49e1-ad75-60514b62ee86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG nova.network.neutron [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updated VIF entry in instance network info cache for port 4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG nova.network.neutron [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updating instance_info_cache with network_info: [{"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad961d-cd36-43c3-8005-f72767dc77d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa033684-ecdc-491f-985c-d39f18481df2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e8b704e3-d98b-4845-83dc-b94e0d65d3c7 req-b1e2fbaa-e65e-41c5-9190-d3e78f553b12 service nova] Releasing lock "refresh_cache-cafd98ea-fe9e-4159-a454-6833bdcb8934" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:35 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:37:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d657a1-675b-4eb0-9ebc-edb53eb84de6]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG os_brick.utils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:35 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updating existing volume attachment record: e0bcff0a-9a73-4db3-aa27-2d6425d8c709 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:37:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:36 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245441.977618, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:37:36 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] VM Stopped (Lifecycle Event)
Apr 11 20:37:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d12cd7e0-75cd-49c1-b045-0dddc0d07615 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:37:37 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245442.4243226, 7831232f-c75e-4403-919d-bc2d69b659e5 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:37:37 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] VM Stopped (Lifecycle Event)
Apr 11 20:37:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1e1a7a77-ddde-47da-b49f-a1eba30aec87 None None] [instance: 7831232f-c75e-4403-919d-bc2d69b659e5] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-changed-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Refreshing instance network info cache due to event network-changed-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Acquiring lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Acquired lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Refreshing network info cache for port 1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updated VIF entry in instance network info cache for port 1a812da6-b951-42d6-a9ef-d61fdb2f6ccd. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updating instance_info_cache with network_info: [{"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8fac3d28-9eab-42cc-86b6-f895bda9b180 req-a10460f5-217d-4c8e-8e53-d08f0f5b73c2 service nova] Releasing lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:39 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:39 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:39 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d7e981-65c1-476c-97a3-d9f367e043ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:37:39 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a017c7-6dcb-4966-ab45-7aef851525de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170] added
Apr 11 20:37:39 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c8e7d1-c65a-42a3-a822-09df5d351788]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30016f5-51fa-4623-afaa-33d5c913dcf2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMghAGbc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMghAGbc" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a302aa-33e0-4e10-a436-db320591aeba]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aMghAGbc'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[046259d6-ed21-4226-af9c-72ffd93822bd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ad9e6-9136-4957-aaf5-69166470049b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:40 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:40 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[44730114-24f8-4466-9b65-d9eee74e818d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]
Apr 11 20:37:40 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:40 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbcaab2-d9d5-49f3-b65d-05b7c26347ca]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2a75a5-aa53-48e1-af68-8f85ea7f6b5e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:40 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:40 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f77cb83-c461-46c5-8352-bb165fb7e5d1]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG nova.objects.instance [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'flavor' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:40 user nova-compute[71654]: INFO nova.compute.manager [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Attaching volume ed1f1921-74f8-4bc3-a351-fa770d5ce07d to /dev/vdb
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc967e-3554-4e55-a3ef-90b4949bd643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f92a7b8-d961-4b5f-844e-6a79c8683a13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea11c93c-1e1c-427e-bc29-88a15ea68dd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[852384ed-4ca6-4e34-8631-cbf9fcaa8a11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26338373866313561', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338373866313561', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:41 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da91f47-3caa-481f-a7f1-642c11fde38b]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updating existing volume attachment record: 10b00d76-17e3-455c-9641-bc4ed50e9764 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'flavor' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:37:41 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:41 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:37:41 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:41 user nova-compute[71654]:   <serial>54c1df9d-22e1-4a3b-a9f9-8200f8463170</serial>
Apr 11 20:37:41 user nova-compute[71654]: </disk>
Apr 11 20:37:41 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] No VIF found with MAC fa:16:3e:6d:16:ca, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:37:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1f19cca-bb08-4683-bc35-2650fefe0958 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.636s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG os_brick.utils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4d6d67-a8d8-47ff-bef0-e3a0bb61e7f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc08b76-6e31-410b-8137-f3816ed3008d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f735b8d-e4e9-4ce7-a72f-3a77e74216a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ae78e-5c00-49bf-9f33-3a72d373863f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:43 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:37:43 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee5305-ff9c-4239-a19d-f717fabf2041]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:37:43 user nova-compute[71654]: DEBUG os_brick.utils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:43 user nova-compute[71654]: INFO nova.compute.manager [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Swapping volume 54c1df9d-22e1-4a3b-a9f9-8200f8463170 for b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-changed-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Refreshing instance network info cache due to event network-changed-81fa518b-09cd-4072-b9be-2f74d2453d76. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Acquiring lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Acquired lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Refreshing network info cache for port 81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "interface-b7d2dbd0-544c-4146-b35c-125eef81c281-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "interface-b7d2dbd0-544c-4146-b35c-125eef81c281-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'flavor' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updated VIF entry in instance network info cache for port 81fa518b-09cd-4072-b9be-2f74d2453d76. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01f3ee0c-ea62-4943-a7ba-3c7c84784168 req-cedde59e-a5c4-4c4e-bda5-2ee3cac98459 service nova] Releasing lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'pci_requests' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:37:44 user nova-compute[71654]: DEBUG nova.policy [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05684678d0cd4ccea78238d20d561f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e31bd9e6e4d5e9cff3e4f2c1cf412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:37:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Successfully created port: 96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Successfully updated port: 96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquired lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-changed-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Refreshing instance network info cache due to event network-changed-96808211-12b7-43cd-8ca0-02265ff49938. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Acquiring lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Releasing lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Acquired lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Refreshing network info cache for port 96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG os_vif [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96808211-12, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96808211-12, col_values=(('external_ids', {'iface-id': '96808211-12b7-43cd-8ca0-02265ff49938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:15:5f', 'vm-uuid': 'b7d2dbd0-544c-4146-b35c-125eef81c281'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:46 user nova-compute[71654]: INFO os_vif [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12')
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] attach device xml: <interface type="ethernet">
Apr 11 20:37:46 user nova-compute[71654]:   <mac address="fa:16:3e:fb:15:5f"/>
Apr 11 20:37:46 user nova-compute[71654]:   <model type="virtio"/>
Apr 11 20:37:46 user nova-compute[71654]:   <mtu size="1442"/>
Apr 11 20:37:46 user nova-compute[71654]:   <target dev="tap96808211-12"/>
Apr 11 20:37:46 user nova-compute[71654]: </interface>
Apr 11 20:37:46 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:37:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:37:47 user nova-compute[71654]: WARNING nova.compute.manager [req-8064f9e9-2b9b-4a3e-9981-5f56a375acdc req-6a8dbf13-1ac8-4444-b1d1-4ff3dc7f5b2b service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 for instance with vm_state active and task_state None.
Apr 11 20:37:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No BDM found with device name hda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No VIF found with MAC fa:16:3e:12:92:b7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:37:47 user nova-compute[71654]:   <nova:package version="0.0.0"/>
Apr 11 20:37:47 user nova-compute[71654]:   <nova:name>tempest-device-tagging-server-1083627248</nova:name>
Apr 11 20:37:47 user nova-compute[71654]:   <nova:creationTime>2023-04-11 20:37:47</nova:creationTime>
Apr 11 20:37:47 user nova-compute[71654]:   <nova:flavor name="m1.nano">
Apr 11 20:37:47 user nova-compute[71654]:     <nova:memory>128</nova:memory>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:disk>1</nova:disk>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:swap>0</nova:swap>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:vcpus>1</nova:vcpus>
Apr 11 20:37:47 user nova-compute[71654]:   </nova:flavor>
Apr 11 20:37:47 user nova-compute[71654]:   <nova:owner>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:user uuid="05684678d0cd4ccea78238d20d561f3f">tempest-TaggedAttachmentsTest-1851174411-project-member</nova:user>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:project uuid="d40e31bd9e6e4d5e9cff3e4f2c1cf412">tempest-TaggedAttachmentsTest-1851174411</nova:project>
Apr 11 20:37:47 user nova-compute[71654]:   </nova:owner>
Apr 11 20:37:47 user nova-compute[71654]:   <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:37:47 user nova-compute[71654]:   <nova:ports>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:port uuid="81fa518b-09cd-4072-b9be-2f74d2453d76">
Apr 11 20:37:47 user nova-compute[71654]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:37:47 user nova-compute[71654]:     </nova:port>
Apr 11 20:37:47 user nova-compute[71654]:     <nova:port uuid="96808211-12b7-43cd-8ca0-02265ff49938">
Apr 11 20:37:47 user nova-compute[71654]:       <nova:ip type="fixed" address="10.10.10.14" ipVersion="4"/>
Apr 11 20:37:47 user nova-compute[71654]:     </nova:port>
Apr 11 20:37:47 user nova-compute[71654]:   </nova:ports>
Apr 11 20:37:47 user nova-compute[71654]: </nova:instance>
Apr 11 20:37:47 user nova-compute[71654]:  {{(pid=71654) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a1eec06c-8160-4f9c-94e8-19662f139583 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "interface-b7d2dbd0-544c-4146-b35c-125eef81c281-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.368s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG nova.network.neutron [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updated VIF entry in instance network info cache for port 96808211-12b7-43cd-8ca0-02265ff49938. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG nova.network.neutron [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e8badb54-3e8f-4535-995e-a369eb8db779 req-15971df1-656f-48bc-80e6-98c309aa9f2c service nova] Releasing lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siFVBeMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:48 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:48 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:48 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[123db52d-8274-497b-8cb3-f79955d9523f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:37:48 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'flavor' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[934839d9-6cea-40fb-a931-6bdac3ead6a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d] added
Apr 11 20:37:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bc188-9910-4116-aee0-634f261f75fe]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[17019f52-8030-40f2-9929-16ab35364c94]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siFVBeMZ {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siFVBeMZ" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0720fc-4a8a-4e52-852e-f1a231f17fff]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'siFVBeMZ'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[be988209-ebba-4955-86b5-409f61a3b00d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd2926-010e-4262-b1d0-149bf71b17ce]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd33dadc-0e87-44a3-be9b-234e2f334ee7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260]
Apr 11 20:37:48 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf60d7ed-fe77-450a-9bfe-41c1b29393c6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:48 user nova-compute[71654]: INFO nova.compute.manager [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Attaching volume e76aa8dd-e32a-41c4-8881-5bbf9958a225 to /dev/vdb
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c00fb3a-7156-454d-bc32-d612c6c069c8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:48 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c93dc-cf0d-4542-a5e8-551be3bd298b]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siFVBeMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[35814961-f4e7-47c1-8429-cc91b28c74f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2dd1ec-a3d4-4546-b36d-f208b481bc2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5277e1-0540-4e91-8c58-8acd6fa169da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7577c6a0-8f29-4577-8fb8-e134a24eaaec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:48 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:37:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83d900-5010-46d5-8ead-88e69fdda19b]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:48 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating existing volume attachment record: 4e4b0efe-1445-43b9-8d34-1f01fb140abe {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-changed-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Refreshing instance network info cache due to event network-changed-4bad185c-c76d-4162-8213-384229da15ca. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Acquiring lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Acquired lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.network.neutron [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Refreshing network info cache for port 4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:37:49 user nova-compute[71654]: WARNING nova.compute.manager [req-d47a04c1-75c7-433a-b16a-4fd55a05c64d req-94ba3197-9ce7-43b2-a3fa-1d0a3e9a5a16 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 for instance with vm_state active and task_state None.
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbDlXHej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cafd98ea-fe9e-4159-a454-6833bdcb8934', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5508baa-4461-4b70-9b47-f0414d386013', 'serial': 'b5508baa-4461-4b70-9b47-f0414d386013'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cafd98ea-fe9e-4159-a454-6833bdcb8934', 'attached_at': '', 'detached_at': '', 'volume_id': '54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'serial'} {{(pid=71654) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbDlXHej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:49 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23862366664353131', 'path': '/dev/sdf'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862366664353131', 'path': '/dev/sdf'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.053s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:49 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:49 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.objects.instance [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'flavor' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1aa7ae-87da-407c-9368-10dcad780f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:37:49 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:37:49 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:49 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:37:49 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:49 user nova-compute[71654]:   <serial>ed1f1921-74f8-4bc3-a351-fa770d5ce07d</serial>
Apr 11 20:37:49 user nova-compute[71654]: </disk>
Apr 11 20:37:49 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1e102-0851-4b31-83b0-d9feeaa2a0fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013] added
Apr 11 20:37:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[88efb483-49d6-4140-81c8-eb20dcabed03]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527ad47-6595-424f-a805-50b21cab9c77]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbDlXHej {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbDlXHej" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f1e1e-7d3d-4b83-9da2-2016a40cb657]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zbDlXHej'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d76d90-2c1e-47bf-8f07-4b3269f085f2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8d493-58b9-40b4-bb42-36d963197faa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.network.neutron [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updated VIF entry in instance network info cache for port 4bad185c-c76d-4162-8213-384229da15ca. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG nova.network.neutron [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updating instance_info_cache with network_info: [{"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc7181f4-61cc-4628-906b-f5f217e97d1d req-e1c6b6ea-0b76-42e0-977d-c1a99288f62b service nova] Releasing lock "refresh_cache-674a4347-8da2-4455-8e90-0fd358b5f696" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44ab3f4-44d5-4687-a43f-b1391d8c3a61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260]
Apr 11 20:37:49 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937def3-0f85-43eb-9a94-f73311a16ec2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1686d7c-febf-4d53-a3e1-4bd5dae71f29]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:49 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfbcb79-09b8-40e0-b3dc-7ff7b0055549]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbDlXHej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No VIF found with MAC fa:16:3e:44:b5:bf, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-41f0ba01-a2a9-4870-a28a-61edcaee1be1 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.152s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23530343732646565', 'path': '/dev/sdg'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530343732646565', 'path': '/dev/sdg'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:37:50 user nova-compute[71654]: DEBUG nova.objects.instance [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lazy-loading 'flavor' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:51 user nova-compute[71654]: INFO nova.compute.manager [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Detaching volume ed1f1921-74f8-4bc3-a351-fa770d5ce07d
Apr 11 20:37:51 user nova-compute[71654]: INFO nova.virt.block_device [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Attempting to driver detach volume ed1f1921-74f8-4bc3-a351-fa770d5ce07d from mountpoint /dev/vdb
Apr 11 20:37:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Attempting to detach device vdb from instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:37:51 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:51 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:37:51 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:51 user nova-compute[71654]:   <serial>ed1f1921-74f8-4bc3-a351-fa770d5ce07d</serial>
Apr 11 20:37:51 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:37:51 user nova-compute[71654]: </disk>
Apr 11 20:37:51 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:37:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Successfully detached device vdb from instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 from the persistent domain config.
Apr 11 20:37:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:37:51 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:51 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:37:51 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:51 user nova-compute[71654]:   <serial>ed1f1921-74f8-4bc3-a351-fa770d5ce07d</serial>
Apr 11 20:37:51 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:37:51 user nova-compute[71654]: </disk>
Apr 11 20:37:51 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245472.179675, 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:37:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Successfully detached device vdb from instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 from the live domain config.
Apr 11 20:37:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siFVBeMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:52 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[43747f87-87e4-4c33-87fd-0bdefbce24be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:37:52 user nova-compute[71654]: No targets found.
Apr 11 20:37:52 user nova-compute[71654]: iSNS:
Apr 11 20:37:52 user nova-compute[71654]: No targets found.
Apr 11 20:37:52 user nova-compute[71654]: STATIC:
Apr 11 20:37:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127
Apr 11 20:37:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:37:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:37:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:37:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d
Apr 11 20:37:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:37:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:52 user nova-compute[71654]: FIRMWARE:
Apr 11 20:37:52 user nova-compute[71654]: No targets found.
Apr 11 20:37:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:37:52 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:37:52 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4261321-4b91-4d87-858e-af512f59a66f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d19cdc-92eb-4f65-bcbc-0effa9fb3d52]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d (non-flash)
Apr 11 20:37:52 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb445a4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d'): ({'sdf'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Removing single pathed devices sdf {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab83ee0-1f33-45c8-8274-40798780736d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 350224384 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac561e-2b6a-416b-b26c-a2293bf7b97a]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flushing IO for device /dev/sdf {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f7c239-f37c-48d8-9125-4ab77009fbff]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[47536562-e544-44fa-bb2b-94a63581a56b]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7f4b6-4c84-470f-8321-f8d8c03e2ce2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c5f18-ef0c-49d8-82ba-ae59b5708ee2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260]
Apr 11 20:37:52 user nova-compute[71654]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1f1921-74f8-4bc3-a351-fa770d5ce07d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d241ddc-ef9b-4769-a998-3294b0f68896]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] <== disconnect_volume: return (397ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:37:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 510656512 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'flavor' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 624951296 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:53 user nova-compute[71654]: INFO nova.compute.manager [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Attaching volume d0c7da85-751f-48ee-bcb9-3d2b8296dd79 to /dev/sdc
Apr 11 20:37:53 user nova-compute[71654]: DEBUG os_brick.utils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ec7bb-94a3-4cdf-9a83-66df1d308ed6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d37b32-1015-4ec0-928f-131c0b598166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8035bab-eb30-4496-81bd-9571fb020375]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb9e50f-cbb0-4271-a423-b06c7b73d754]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:37:53 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[31081aeb-3343-416c-a7e0-9109a978a763]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG os_brick.utils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updating existing volume attachment record: 3c1c79c2-12d8-4852-878b-e3ef0b7cc651 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 727711744 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'flavor' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-88c2bc5b-9b26-4b88-8842-d74680a7b805 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.482s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 888143872 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvucnxOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:54 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:54 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:54 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc002502-71eb-4dd9-b985-9e3d87329266]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:37:54 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[93246b62-6adb-42aa-acb2-2eb3612dcfd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225] added
Apr 11 20:37:54 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[558206ed-acee-473c-853d-5bf05a64a041]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b87be-0ad6-413e-9536-d7b8a6b5d840]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvucnxOa {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvucnxOa" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38cecea-303d-4caa-9461-2cd5dabb6982]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvucnxOa'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee910f-1c11-47f2-ad2c-e5352b7df2ec]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[736dd5d2-2f21-4f2c-a0ff-a4517c7ee301]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:54 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:54 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --login" returned: 0 in 1.090s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4cd944-129f-4e0a-98d7-6361448475cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260]
Apr 11 20:37:55 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf262d6d-24f9-44f7-b602-4cab73edd18c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91dd769-c6bf-4a21-9720-5035cab0bb83]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.374s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39d7618-05eb-4ad8-b984-b2b52f6702e9]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:37:56 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvucnxOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:37:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.422s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] <== connect_volume: return (2425ms) {'type': 'block', 'scsi_wwn': '26135316235383439', 'path': '/dev/sdf'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135316235383439', 'path': '/dev/sdf'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.012s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'flavor' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de48b67-4dfd-4310-9d6d-676044a0eeb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:37:57 user nova-compute[71654]: No targets found.
Apr 11 20:37:57 user nova-compute[71654]: iSNS:
Apr 11 20:37:57 user nova-compute[71654]: No targets found.
Apr 11 20:37:57 user nova-compute[71654]: STATIC:
Apr 11 20:37:57 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127
Apr 11 20:37:57 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:57 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:57 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:37:57 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:57 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:57 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:37:57 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:57 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:57 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225
Apr 11 20:37:57 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:57 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:57 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:37:57 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:57 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:57 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:37:57 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:37:57 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:37:57 user nova-compute[71654]: FIRMWARE:
Apr 11 20:37:57 user nova-compute[71654]: No targets found.
Apr 11 20:37:57 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:37:57 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:37:57 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:37:57 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:57 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:37:57 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:57 user nova-compute[71654]:   <serial>e76aa8dd-e32a-41c4-8881-5bbf9958a225</serial>
Apr 11 20:37:57 user nova-compute[71654]: </disk>
Apr 11 20:37:57 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9cc57d-7ca0-4d83-8809-7d2880b25fb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e460b89-9e14-4333-866f-498202c43376]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:57 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46f89480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c9d10-7724-437e-8d20-1d8a8177a2d0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6012fb-ac46-4772-af14-d97b316755a0]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d12217-97a7-4898-ae17-06d810bf105e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf16016-846d-4420-bba3-d06bcb60e723]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0855c636-a212-428f-b621-700f67500f82]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9dc389-4f07-43d4-a482-7471be3987e0]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]
Apr 11 20:37:57 user nova-compute[71654]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:57 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7febee8-a169-4059-9554-c70c9ac4d2b6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] <== disconnect_volume: return (2329ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbDlXHej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'cafd98ea-fe9e-4159-a454-6833bdcb8934', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5508baa-4461-4b70-9b47-f0414d386013', 'serial'} {{(pid=71654) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] swap_volume: removing Cinder connection for volume 54c1df9d-22e1-4a3b-a9f9-8200f8463170 {{(pid=71654) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No BDM found with device name hda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] No VIF found with MAC fa:16:3e:12:92:b7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:37:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8e873d38-018e-4a8f-b6f5-e7ea1da3bc89 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.113s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:37:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAlFsMox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:58 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:58 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:37:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:37:58 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:37:59 user nova-compute[71654]: INFO nova.compute.manager [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Detaching volume e76aa8dd-e32a-41c4-8881-5bbf9958a225
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9161f21-78d3-48f1-9ae7-ccba2615a169]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:37:59 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[312cea80-260c-4342-8a2c-82a2093750f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79] added
Apr 11 20:37:59 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dee8ee3-df6f-4838-8b12-ee726121835f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: INFO nova.virt.block_device [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Attempting to driver detach volume e76aa8dd-e32a-41c4-8881-5bbf9958a225 from mountpoint /dev/vdb
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Attempting to detach device vdb from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:37:59 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:59 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:37:59 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:59 user nova-compute[71654]:   <serial>e76aa8dd-e32a-41c4-8881-5bbf9958a225</serial>
Apr 11 20:37:59 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 20:37:59 user nova-compute[71654]: </disk>
Apr 11 20:37:59 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ee69d-2ab2-4318-ad63-0c0cfbe4b442]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAlFsMox {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully detached device vdb from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the persistent domain config.
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:37:59 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:37:59 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:37:59 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:37:59 user nova-compute[71654]:   <serial>e76aa8dd-e32a-41c4-8881-5bbf9958a225</serial>
Apr 11 20:37:59 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 20:37:59 user nova-compute[71654]: </disk>
Apr 11 20:37:59 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAlFsMox" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c2d8e-13a8-435e-8cc0-0b3bdc873465]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jAlFsMox'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3282da-6542-4946-ab4e-ab279f48232b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a07808-ed11-42ed-99c9-12c0a6b7908a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] swap_volume: Updating volume 54c1df9d-22e1-4a3b-a9f9-8200f8463170 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zbDlXHej", "auth_password": "93c2YoiyICpbxj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "b5508baa-4461-4b70-9b47-f0414d386013"}, "status": "reserved", "instance": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "attached_at": "", "detached_at": "", "volume_id": "b5508baa-4461-4b70-9b47-f0414d386013", "serial": "b5508baa-4461-4b70-9b47-f0414d386013"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b5508baa-4461-4b70-9b47-f0414d386013', 'no_device': None, 'attachment_id': 'fcb8ff1a-323c-40b2-9f2d-c47f3f00554f'} {{(pid=71654) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-908baa9b-c822-4693-81a2-9ba47bcd104c tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.941s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[82126df8-a462-4529-bf6d-d7543635adf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260]
Apr 11 20:37:59 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260] successful.
Apr 11 20:37:59 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e31173-5e31-44cb-a0ec-cbb8416c70bb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b043dbdc-c121-41cc-8f8a-a82d53ef90c9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:37:59 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:37:59 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[903294e8-de75-4e51-b97c-1d1a79a9d6a5]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAlFsMox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245479.487482, b7d2dbd0-544c-4146-b35c-125eef81c281 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:37:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully detached device vdb from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the live domain config.
Apr 11 20:37:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvucnxOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:37:59 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:37:59 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.utils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b63c4-1e02-4a93-ae1f-d3bf1015e12c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b7821-2646-423f-a8a2-c57bbf26d174]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c306df1-58f4-4235-a798-5f738225170e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d117b-1e6c-415c-988d-d61b26b77415]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:38:00 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acfd48a-f551-41ed-b109-124fb608292c]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.utils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:00 user nova-compute[71654]: INFO nova.compute.manager [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Swapping volume b5508baa-4461-4b70-9b47-f0414d386013 for 54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23564366230386533', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564366230386533', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.841s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'flavor' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8c9d17-d864-4535-8dcb-eb8f8c5295e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:00 user nova-compute[71654]: No targets found.
Apr 11 20:38:00 user nova-compute[71654]: iSNS:
Apr 11 20:38:00 user nova-compute[71654]: No targets found.
Apr 11 20:38:00 user nova-compute[71654]: STATIC:
Apr 11 20:38:00 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127
Apr 11 20:38:00 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:00 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:00 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:38:00 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:00 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:00 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225
Apr 11 20:38:00 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:00 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:00 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:38:00 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:00 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:00 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79
Apr 11 20:38:00 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:00 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:00 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:38:00 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:00 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:00 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:00 user nova-compute[71654]: No targets found.
Apr 11 20:38:00 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:00 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:00 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:38:00 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:38:00 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:38:00 user nova-compute[71654]:   <target dev="sdc" bus="scsi"/>
Apr 11 20:38:00 user nova-compute[71654]:   <serial>d0c7da85-751f-48ee-bcb9-3d2b8296dd79</serial>
Apr 11 20:38:00 user nova-compute[71654]:   <address type="drive" controller="0" unit="2"/>
Apr 11 20:38:00 user nova-compute[71654]: </disk>
Apr 11 20:38:00 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a41c2-dd7c-4eb8-96a0-e9655e6549a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea176a8-8ab1-4c04-8c93-284a5a3a82cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:00 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:00 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46f89000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225'): ({'sdf'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Removing single pathed devices sdf {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bee2aec-a829-4c88-9cb5-e47bcdb6bfc7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7eb259-911c-4f81-b0f5-4d0bf2bd5e53]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Flushing IO for device /dev/sdf {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fcf4f0-ee80-44ad-9d56-5bdbc0502fcf]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83539f-0da9-48d8-88b7-f90c37d87f07]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb7afc-19ad-4ddc-8ef8-8f1c7d24fce4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad53574-ea10-4fce-8079-c1eb7697fbe2]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260]
Apr 11 20:38:00 user nova-compute[71654]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:00 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e76aa8dd-e32a-41c4-8881-5bbf9958a225 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba9fce-924f-45c4-9a5b-c5171d80b8b5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] <== disconnect_volume: return (1162ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No BDM found with device name sda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] No VIF found with MAC fa:16:3e:8d:ef:2d, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:38:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f79249b-9a9a-4718-975b-5e40464d33df tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.627s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:01 user nova-compute[71654]: INFO nova.compute.manager [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Detaching volume d0c7da85-751f-48ee-bcb9-3d2b8296dd79
Apr 11 20:38:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:01 user nova-compute[71654]: INFO nova.virt.block_device [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Attempting to driver detach volume d0c7da85-751f-48ee-bcb9-3d2b8296dd79 from mountpoint /dev/sdc
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Attempting to detach device sdc from instance 674a4347-8da2-4455-8e90-0fd358b5f696 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:38:01 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:38:01 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:38:01 user nova-compute[71654]:   <target dev="sdc" bus="scsi"/>
Apr 11 20:38:01 user nova-compute[71654]:   <serial>d0c7da85-751f-48ee-bcb9-3d2b8296dd79</serial>
Apr 11 20:38:01 user nova-compute[71654]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 20:38:01 user nova-compute[71654]: </disk>
Apr 11 20:38:01 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:38:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Successfully detached device sdc from instance 674a4347-8da2-4455-8e90-0fd358b5f696 from the persistent domain config.
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 674a4347-8da2-4455-8e90-0fd358b5f696 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:38:01 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:38:01 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:38:01 user nova-compute[71654]:   <target dev="sdc" bus="scsi"/>
Apr 11 20:38:01 user nova-compute[71654]:   <serial>d0c7da85-751f-48ee-bcb9-3d2b8296dd79</serial>
Apr 11 20:38:01 user nova-compute[71654]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 20:38:01 user nova-compute[71654]: </disk>
Apr 11 20:38:01 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245481.902988, 674a4347-8da2-4455-8e90-0fd358b5f696 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Successfully detached device sdc from instance 674a4347-8da2-4455-8e90-0fd358b5f696 from the live domain config.
Apr 11 20:38:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAlFsMox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:01 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9537de0-f6f8-40cf-965a-cb6cdca55ac2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:01 user nova-compute[71654]: No targets found.
Apr 11 20:38:01 user nova-compute[71654]: iSNS:
Apr 11 20:38:01 user nova-compute[71654]: No targets found.
Apr 11 20:38:01 user nova-compute[71654]: STATIC:
Apr 11 20:38:01 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127
Apr 11 20:38:01 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:01 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:01 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:38:01 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:01 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:01 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:38:01 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:01 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:01 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79
Apr 11 20:38:01 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:01 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:01 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:38:01 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:01 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:01 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:01 user nova-compute[71654]: No targets found.
Apr 11 20:38:01 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:01 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:01 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[abea3b8c-e129-4dc2-963d-96903a006b01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[82136c05-f4e6-4f8a-a910-e33b0104b653]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:02 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb45895750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcffc0c-67a2-40e7-b882-860f84456b2d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab63789-602f-471e-9cec-0cace40dadb1]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e321e85-c3c0-4e9c-a7e3-192902ec67eb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1defc2b3-9d05-4e1d-bfaf-6a2cee4b1cb6]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4374f-7e3b-4985-9e79-c5b9df77c66f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ad0c3-cc7d-428e-91e5-1afedddb5295]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260]
Apr 11 20:38:02 user nova-compute[71654]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0c7da85-751f-48ee-bcb9-3d2b8296dd79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e3ad07-03b6-4e50-8297-f9c6d3f07d82]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] <== disconnect_volume: return (337ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-changed-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing instance network info cache due to event network-changed-e31567ff-e573-4ed5-a006-bd58e4910906. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Acquiring lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Acquired lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Refreshing network info cache for port e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updated VIF entry in instance network info cache for port e31567ff-e573-4ed5-a006-bd58e4910906. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d7b5f005-5ec2-4d3a-8aa7-1db733b62052 req-2ae9a37a-0d62-450c-a9bd-930a18bd5395 service nova] Releasing lock "refresh_cache-531a0692-eac9-4ac7-95dd-abb138512f30" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'flavor' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0cc5d4a7-c93b-441c-9be3-71f69bfecb99 tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:03 user nova-compute[71654]: INFO nova.compute.manager [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Terminating instance
Apr 11 20:38:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-vif-unplugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] No waiting events found dispatching network-vif-unplugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-aedee1a1-4a39-48bb-9c17-a02bc740926c req-ee33d814-418f-4e64-bae6-9b2d76abb503 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-vif-unplugged-4bad185c-c76d-4162-8213-384229da15ca for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "531a0692-eac9-4ac7-95dd-abb138512f30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:03 user nova-compute[71654]: INFO nova.compute.manager [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Terminating instance
Apr 11 20:38:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Instance destroyed successfully.
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lazy-loading 'resources' on Instance uuid 674a4347-8da2-4455-8e90-0fd358b5f696 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2072587823',display_name='tempest-AttachSCSIVolumeTestJSON-server-2072587823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2072587823',id=8,image_ref='b5d3e363-bdbc-4f56-9a89-97905d5b374b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdT9m+B9YySsnmiLIjHxu4QvlA3mtfywAqzUXZhGrDg1cDaXTY+nvap6IYEGSvC+OLNvbuM7456Nky3u3j5bHxO363IT9g/IDQ0Kx0ome2u3RH00PsRCuHF5RqYu3myFg==',key_name='tempest-keypair-790069645',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='284929c90a1e41559d5aa3885cd928b4',ramdisk_id='',reservation_id='r-8jha9nmk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b5d3e363-bdbc-4f56-9a89-97905d5b374b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1026499087',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1026499087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a83734398b4ac6bb576381f2557f76',uuid=674a4347-8da2-4455-8e90-0fd358b5f696,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Converting VIF {"id": "4bad185c-c76d-4162-8213-384229da15ca", "address": "fa:16:3e:8d:ef:2d", "network": {"id": "b4cef739-4f35-4410-8e20-8dba69075711", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1611208448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "284929c90a1e41559d5aa3885cd928b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bad185c-c7", "ovs_interfaceid": "4bad185c-c76d-4162-8213-384229da15ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG os_vif [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bad185c-c7, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-cea2bd75-d8c7-49f2-bb6b-0cc07ce04324 req-73ae00d0-9e47-4858-b370-c10e78e426a4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-e31567ff-e573-4ed5-a006-bd58e4910906 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: INFO os_vif [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ef:2d,bridge_name='br-int',has_traffic_filtering=True,id=4bad185c-c76d-4162-8213-384229da15ca,network=Network(b4cef739-4f35-4410-8e20-8dba69075711),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bad185c-c7')
Apr 11 20:38:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Deleting instance files /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696_del
Apr 11 20:38:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Deletion of /opt/stack/data/nova/instances/674a4347-8da2-4455-8e90-0fd358b5f696_del complete
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: INFO nova.compute.manager [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-00d973dc-4040-4a5c-9c92-865ffeb5e05e req-e77aa3ef-3d4d-4eb2-8dd8-040110805f6f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'flavor' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0a892642-d39c-47c2-98c5-88b69206c954 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.038s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cafd98ea-fe9e-4159-a454-6833bdcb8934', 'attached_at': '', 'detached_at': '', 'volume_id': '54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'serial': '54c1df9d-22e1-4a3b-a9f9-8200f8463170'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbDlXHej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'b5508baa-4461-4b70-9b47-f0414d386013'}, 'status': 'reserved', 'instance': 'cafd98ea-fe9e-4159-a454-6833bdcb8934', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5508baa-4461-4b70-9b47-f0414d386013', 'serial'} {{(pid=71654) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:05 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:05 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:05 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9463b301-05fd-4aa3-93f9-fe0036563696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:38:05 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d837800f-073e-4034-afcb-d0ac26e1bf1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170] added
Apr 11 20:38:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[473201f1-c50b-4141-8ebd-4ecc887b9698]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e4b27-d850-41b0-b5a5-9089096f73fd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMghAGbc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMghAGbc" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90e3aa-8ada-4d39-959e-38cb34e615e7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aMghAGbc'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baad17c-eff3-42b5-b671-35fd99cee8c3]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c5b547-6d03-49fc-9352-5224d4493f37]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090af73-c37e-4715-83bd-cfe5b928a7c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]
Apr 11 20:38:05 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[409955a6-7690-4fb7-b72b-652081cb8524]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[557557a7-9050-4a6f-9c62-2b311748429e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:05 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0150e674-2140-44e7-98c4-96fd15ed87e0]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:38:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Instance destroyed successfully.
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lazy-loading 'resources' on Instance uuid 531a0692-eac9-4ac7-95dd-abb138512f30 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "interface-b7d2dbd0-544c-4146-b35c-125eef81c281-96808211-12b7-43cd-8ca0-02265ff49938" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "interface-b7d2dbd0-544c-4146-b35c-125eef81c281-96808211-12b7-43cd-8ca0-02265ff49938" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape31567ff-e5, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'flavor' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fb:15:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap96808211-12"/></interface> {{(pid=71654) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fb:15:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap96808211-12"/></interface> {{(pid=71654) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Attempting to detach device tap96808211-12 from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] detach device xml: <interface type="ethernet">
Apr 11 20:38:05 user nova-compute[71654]:   <mac address="fa:16:3e:fb:15:5f"/>
Apr 11 20:38:05 user nova-compute[71654]:   <model type="virtio"/>
Apr 11 20:38:05 user nova-compute[71654]:   <mtu size="1442"/>
Apr 11 20:38:05 user nova-compute[71654]:   <target dev="tap96808211-12"/>
Apr 11 20:38:05 user nova-compute[71654]: </interface>
Apr 11 20:38:05 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fb:15:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap96808211-12"/></interface> {{(pid=71654) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 20:38:05 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:80:21,bridge_name='br-int',has_traffic_filtering=True,id=e31567ff-e573-4ed5-a006-bd58e4910906,network=Network(4bd0e6c3-35c1-4e52-aa48-bebac03add01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31567ff-e5')
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bb7820c-fc, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fb:15:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap96808211-12"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 11 20:38:05 user nova-compute[71654]:   <name>instance-00000007</name>
Apr 11 20:38:05 user nova-compute[71654]:   <uuid>b7d2dbd0-544c-4146-b35c-125eef81c281</uuid>
Apr 11 20:38:05 user nova-compute[71654]:   <metadata>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:38:05 user nova-compute[71654]:   <nova:package version="0.0.0"/>
Apr 11 20:38:05 user nova-compute[71654]:   <nova:name>tempest-device-tagging-server-1083627248</nova:name>
Apr 11 20:38:05 user nova-compute[71654]:   <nova:creationTime>2023-04-11 20:37:47</nova:creationTime>
Apr 11 20:38:05 user nova-compute[71654]:   <nova:flavor name="m1.nano">
Apr 11 20:38:05 user nova-compute[71654]:     <nova:memory>128</nova:memory>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:disk>1</nova:disk>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:swap>0</nova:swap>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:vcpus>1</nova:vcpus>
Apr 11 20:38:05 user nova-compute[71654]:   </nova:flavor>
Apr 11 20:38:05 user nova-compute[71654]:   <nova:owner>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:user uuid="05684678d0cd4ccea78238d20d561f3f">tempest-TaggedAttachmentsTest-1851174411-project-member</nova:user>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:project uuid="d40e31bd9e6e4d5e9cff3e4f2c1cf412">tempest-TaggedAttachmentsTest-1851174411</nova:project>
Apr 11 20:38:05 user nova-compute[71654]:   </nova:owner>
Apr 11 20:38:05 user nova-compute[71654]:   <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:38:05 user nova-compute[71654]:   <nova:ports>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:port uuid="81fa518b-09cd-4072-b9be-2f74d2453d76">
Apr 11 20:38:05 user nova-compute[71654]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:38:05 user nova-compute[71654]:     </nova:port>
Apr 11 20:38:05 user nova-compute[71654]:     <nova:port uuid="96808211-12b7-43cd-8ca0-02265ff49938">
Apr 11 20:38:05 user nova-compute[71654]:       <nova:ip type="fixed" address="10.10.10.14" ipVersion="4"/>
Apr 11 20:38:05 user nova-compute[71654]:     </nova:port>
Apr 11 20:38:05 user nova-compute[71654]:   </nova:ports>
Apr 11 20:38:05 user nova-compute[71654]: </nova:instance>
Apr 11 20:38:05 user nova-compute[71654]:   </metadata>
Apr 11 20:38:05 user nova-compute[71654]:   <memory unit='KiB'>131072</memory>
Apr 11 20:38:05 user nova-compute[71654]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 20:38:05 user nova-compute[71654]:   <vcpu placement='static'>1</vcpu>
Apr 11 20:38:05 user nova-compute[71654]:   <resource>
Apr 11 20:38:05 user nova-compute[71654]:     <partition>/machine</partition>
Apr 11 20:38:05 user nova-compute[71654]:   </resource>
Apr 11 20:38:05 user nova-compute[71654]:   <sysinfo type='smbios'>
Apr 11 20:38:05 user nova-compute[71654]:     <system>
Apr 11 20:38:05 user nova-compute[71654]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 20:38:05 user nova-compute[71654]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 20:38:05 user nova-compute[71654]:       <entry name='version'>0.0.0</entry>
Apr 11 20:38:05 user nova-compute[71654]:       <entry name='serial'>b7d2dbd0-544c-4146-b35c-125eef81c281</entry>
Apr 11 20:38:05 user nova-compute[71654]:       <entry name='uuid'>b7d2dbd0-544c-4146-b35c-125eef81c281</entry>
Apr 11 20:38:05 user nova-compute[71654]:       <entry name='family'>Virtual Machine</entry>
Apr 11 20:38:05 user nova-compute[71654]:     </system>
Apr 11 20:38:05 user nova-compute[71654]:   </sysinfo>
Apr 11 20:38:05 user nova-compute[71654]:   <os>
Apr 11 20:38:05 user nova-compute[71654]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 20:38:05 user nova-compute[71654]:     <boot dev='hd'/>
Apr 11 20:38:05 user nova-compute[71654]:     <smbios mode='sysinfo'/>
Apr 11 20:38:05 user nova-compute[71654]:   </os>
Apr 11 20:38:05 user nova-compute[71654]:   <features>
Apr 11 20:38:05 user nova-compute[71654]:     <acpi/>
Apr 11 20:38:05 user nova-compute[71654]:     <apic/>
Apr 11 20:38:05 user nova-compute[71654]:     <vmcoreinfo state='on'/>
Apr 11 20:38:05 user nova-compute[71654]:   </features>
Apr 11 20:38:05 user nova-compute[71654]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 20:38:05 user nova-compute[71654]:     <model fallback='forbid'>Nehalem</model>
Apr 11 20:38:05 user nova-compute[71654]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 20:38:05 user nova-compute[71654]:     <feature policy='require' name='vme'/>
Apr 11 20:38:05 user nova-compute[71654]:     <feature policy='require' name='x2apic'/>
Apr 11 20:38:05 user nova-compute[71654]:     <feature policy='require' name='hypervisor'/>
Apr 11 20:38:05 user nova-compute[71654]:   </cpu>
Apr 11 20:38:05 user nova-compute[71654]:   <clock offset='utc'>
Apr 11 20:38:05 user nova-compute[71654]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 20:38:05 user nova-compute[71654]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 20:38:05 user nova-compute[71654]:     <timer name='hpet' present='no'/>
Apr 11 20:38:05 user nova-compute[71654]:   </clock>
Apr 11 20:38:05 user nova-compute[71654]:   <on_poweroff>destroy</on_poweroff>
Apr 11 20:38:05 user nova-compute[71654]:   <on_reboot>restart</on_reboot>
Apr 11 20:38:05 user nova-compute[71654]:   <on_crash>destroy</on_crash>
Apr 11 20:38:05 user nova-compute[71654]:   <devices>
Apr 11 20:38:05 user nova-compute[71654]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 20:38:05 user nova-compute[71654]:     <disk type='file' device='disk'>
Apr 11 20:38:05 user nova-compute[71654]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 20:38:05 user nova-compute[71654]:       <source file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk' index='2'/>
Apr 11 20:38:05 user nova-compute[71654]:       <backingStore type='file' index='3'>
Apr 11 20:38:05 user nova-compute[71654]:         <format type='raw'/>
Apr 11 20:38:05 user nova-compute[71654]:         <source file='/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d'/>
Apr 11 20:38:05 user nova-compute[71654]:         <backingStore/>
Apr 11 20:38:05 user nova-compute[71654]:       </backingStore>
Apr 11 20:38:05 user nova-compute[71654]:       <target dev='vda' bus='virtio'/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='virtio-disk0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </disk>
Apr 11 20:38:05 user nova-compute[71654]:     <disk type='file' device='cdrom'>
Apr 11 20:38:05 user nova-compute[71654]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 20:38:05 user nova-compute[71654]:       <source file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.config' index='1'/>
Apr 11 20:38:05 user nova-compute[71654]:       <backingStore/>
Apr 11 20:38:05 user nova-compute[71654]:       <target dev='hda' bus='ide'/>
Apr 11 20:38:05 user nova-compute[71654]:       <readonly/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='ide0-0-0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </disk>
Apr 11 20:38:05 user nova-compute[71654]:     <controller type='usb' index='0' model='none'>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='usb'/>
Apr 11 20:38:05 user nova-compute[71654]:     </controller>
Apr 11 20:38:05 user nova-compute[71654]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='pci.0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </controller>
Apr 11 20:38:05 user nova-compute[71654]:     <controller type='ide' index='0'>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='ide'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 20:38:05 user nova-compute[71654]:     </controller>
Apr 11 20:38:05 user nova-compute[71654]:     <interface type='ethernet'>
Apr 11 20:38:05 user nova-compute[71654]:       <mac address='fa:16:3e:12:92:b7'/>
Apr 11 20:38:05 user nova-compute[71654]:       <target dev='tap81fa518b-09'/>
Apr 11 20:38:05 user nova-compute[71654]:       <model type='virtio'/>
Apr 11 20:38:05 user nova-compute[71654]:       <mtu size='1442'/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='net0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </interface>
Apr 11 20:38:05 user nova-compute[71654]:     <interface type='ethernet'>
Apr 11 20:38:05 user nova-compute[71654]:       <mac address='fa:16:3e:fb:15:5f'/>
Apr 11 20:38:05 user nova-compute[71654]:       <target dev='tap96808211-12'/>
Apr 11 20:38:05 user nova-compute[71654]:       <model type='virtio'/>
Apr 11 20:38:05 user nova-compute[71654]:       <mtu size='1442'/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='net1'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </interface>
Apr 11 20:38:05 user nova-compute[71654]:     <serial type='pty'>
Apr 11 20:38:05 user nova-compute[71654]:       <source path='/dev/pts/6'/>
Apr 11 20:38:05 user nova-compute[71654]:       <log file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/console.log' append='off'/>
Apr 11 20:38:05 user nova-compute[71654]:       <target type='isa-serial' port='0'>
Apr 11 20:38:05 user nova-compute[71654]:         <model name='isa-serial'/>
Apr 11 20:38:05 user nova-compute[71654]:       </target>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='serial0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </serial>
Apr 11 20:38:05 user nova-compute[71654]:     <console type='pty' tty='/dev/pts/6'>
Apr 11 20:38:05 user nova-compute[71654]:       <source path='/dev/pts/6'/>
Apr 11 20:38:05 user nova-compute[71654]:       <log file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/console.log' append='off'/>
Apr 11 20:38:05 user nova-compute[71654]:       <target type='serial' port='0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='serial0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </console>
Apr 11 20:38:05 user nova-compute[71654]:     <input type='mouse' bus='ps2'>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='input0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </input>
Apr 11 20:38:05 user nova-compute[71654]:     <input type='keyboard' bus='ps2'>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='input1'/>
Apr 11 20:38:05 user nova-compute[71654]:     </input>
Apr 11 20:38:05 user nova-compute[71654]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 11 20:38:05 user nova-compute[71654]:       <listen type='address' address='0.0.0.0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </graphics>
Apr 11 20:38:05 user nova-compute[71654]:     <audio id='1' type='none'/>
Apr 11 20:38:05 user nova-compute[71654]:     <video>
Apr 11 20:38:05 user nova-compute[71654]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='video0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </video>
Apr 11 20:38:05 user nova-compute[71654]:     <memballoon model='virtio'>
Apr 11 20:38:05 user nova-compute[71654]:       <stats period='10'/>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='balloon0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </memballoon>
Apr 11 20:38:05 user nova-compute[71654]:     <rng model='virtio'>
Apr 11 20:38:05 user nova-compute[71654]:       <backend model='random'>/dev/urandom</backend>
Apr 11 20:38:05 user nova-compute[71654]:       <alias name='rng0'/>
Apr 11 20:38:05 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 20:38:05 user nova-compute[71654]:     </rng>
Apr 11 20:38:05 user nova-compute[71654]:   </devices>
Apr 11 20:38:05 user nova-compute[71654]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 20:38:05 user nova-compute[71654]:     <label>libvirt-b7d2dbd0-544c-4146-b35c-125eef81c281</label>
Apr 11 20:38:05 user nova-compute[71654]:     <imagelabel>libvirt-b7d2dbd0-544c-4146-b35c-125eef81c281</imagelabel>
Apr 11 20:38:05 user nova-compute[71654]:   </seclabel>
Apr 11 20:38:05 user nova-compute[71654]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 20:38:05 user nova-compute[71654]:     <label>+64055:+108</label>
Apr 11 20:38:05 user nova-compute[71654]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 20:38:05 user nova-compute[71654]:   </seclabel>
Apr 11 20:38:05 user nova-compute[71654]: </domain>
Apr 11 20:38:05 user nova-compute[71654]:  {{(pid=71654) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 20:38:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully detached device tap96808211-12 from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the persistent domain config.
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] (1/8): Attempting to detach device tap96808211-12 with device alias net1 from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] detach device xml: <interface type="ethernet">
Apr 11 20:38:05 user nova-compute[71654]:   <mac address="fa:16:3e:fb:15:5f"/>
Apr 11 20:38:05 user nova-compute[71654]:   <model type="virtio"/>
Apr 11 20:38:05 user nova-compute[71654]:   <mtu size="1442"/>
Apr 11 20:38:05 user nova-compute[71654]:   <target dev="tap96808211-12"/>
Apr 11 20:38:05 user nova-compute[71654]: </interface>
Apr 11 20:38:05 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Acquiring lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "674a4347-8da2-4455-8e90-0fd358b5f696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] No waiting events found dispatching network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:05 user nova-compute[71654]: WARNING nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received unexpected event network-vif-plugged-4bad185c-c76d-4162-8213-384229da15ca for instance with vm_state active and task_state deleting.
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:05 user nova-compute[71654]: WARNING nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-1bb7820c-fce7-4d0d-8d4c-4d506f0db38e for instance with vm_state active and task_state deleting.
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:05 user nova-compute[71654]: WARNING nova.compute.manager [req-e2b50a40-b26c-4cce-b2b6-03bbeddd63bf req-bcab847e-c6f1-4632-b665-071efafff524 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-2279246f-00a6-4589-b12c-ca5ab19d54a7 for instance with vm_state active and task_state deleting.
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=1bb7820c-fce7-4d0d-8d4c-4d506f0db38e,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1bb7820c-fc')
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33b1d7c0-16, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:dd:2f,bridge_name='br-int',has_traffic_filtering=True,id=33b1d7c0-166a-4aa9-92b4-5b7d16637dc2,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33b1d7c0-16')
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532c5436-45, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:46,bridge_name='br-int',has_traffic_filtering=True,id=532c5436-45ba-4503-a774-4fa206ce6f73,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532c5436-45')
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "address": "fa:16:3e:41:08:12", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58994cba-fc", "ovs_interfaceid": "58994cba-fc42-41f3-9e7c-9d2c4048ba15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58994cba-fc, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:08:12,bridge_name='br-int',has_traffic_filtering=True,id=58994cba-fc42-41f3-9e7c-9d2c4048ba15,network=Network(1132fd57-4fb8-42ff-b70e-665ae0200cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58994cba-fc')
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2279246f-00, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:06 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9c:3c,bridge_name='br-int',has_traffic_filtering=True,id=2279246f-00a6-4589-b12c-ca5ab19d54a7,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2279246f-00')
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-27898241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-27898241',id=9,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE31FdS43jLZ4ZBeYfVk/+G8M2vz3pvi6bkJaH5HMUIOSSyzRs7/0PhxQCQjtXVMx9aUD5gQV9rhrjAFUeAcyaa8ZwiAWBHr4siD+3IXhH4SzsNpfbU6cpBvVdUmFH77A==',key_name='tempest-keypair-1312085823',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caa968f4c38c40719e6169250097c718',ramdisk_id='',reservation_id='r-pcvjm0fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1812283911',owner_user_name='tempest-TaggedBootDevicesTest-1812283911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5d98b3ceee842b08adb37e62e68436e',uuid=531a0692-eac9-4ac7-95dd-abb138512f30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converting VIF {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8d0aab1-43, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:06 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Took 1.61 seconds to deallocate network for instance.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: INFO os_vif [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ff:a0,bridge_name='br-int',has_traffic_filtering=True,id=c8d0aab1-4380-41a7-aeb6-3222168c5c52,network=Network(37c1d133-c3f1-4bd5-8af7-85380cc64d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d0aab1-43')
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzjBQWbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245486.146704, b7d2dbd0-544c-4146-b35c-125eef81c281 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Start waiting for the detach event from libvirt for device tap96808211-12 with device alias net1 for instance b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fb:15:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap96808211-12"/></interface> {{(pid=71654) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fb:15:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap96808211-12"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 11 20:38:06 user nova-compute[71654]:   <name>instance-00000007</name>
Apr 11 20:38:06 user nova-compute[71654]:   <uuid>b7d2dbd0-544c-4146-b35c-125eef81c281</uuid>
Apr 11 20:38:06 user nova-compute[71654]:   <metadata>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:38:06 user nova-compute[71654]:   <nova:package version="0.0.0"/>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:name>tempest-device-tagging-server-1083627248</nova:name>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:creationTime>2023-04-11 20:37:47</nova:creationTime>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:flavor name="m1.nano">
Apr 11 20:38:06 user nova-compute[71654]:     <nova:memory>128</nova:memory>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:disk>1</nova:disk>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:swap>0</nova:swap>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:vcpus>1</nova:vcpus>
Apr 11 20:38:06 user nova-compute[71654]:   </nova:flavor>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:owner>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:user uuid="05684678d0cd4ccea78238d20d561f3f">tempest-TaggedAttachmentsTest-1851174411-project-member</nova:user>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:project uuid="d40e31bd9e6e4d5e9cff3e4f2c1cf412">tempest-TaggedAttachmentsTest-1851174411</nova:project>
Apr 11 20:38:06 user nova-compute[71654]:   </nova:owner>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:ports>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:port uuid="81fa518b-09cd-4072-b9be-2f74d2453d76">
Apr 11 20:38:06 user nova-compute[71654]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:38:06 user nova-compute[71654]:     </nova:port>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:port uuid="96808211-12b7-43cd-8ca0-02265ff49938">
Apr 11 20:38:06 user nova-compute[71654]:       <nova:ip type="fixed" address="10.10.10.14" ipVersion="4"/>
Apr 11 20:38:06 user nova-compute[71654]:     </nova:port>
Apr 11 20:38:06 user nova-compute[71654]:   </nova:ports>
Apr 11 20:38:06 user nova-compute[71654]: </nova:instance>
Apr 11 20:38:06 user nova-compute[71654]:   </metadata>
Apr 11 20:38:06 user nova-compute[71654]:   <memory unit='KiB'>131072</memory>
Apr 11 20:38:06 user nova-compute[71654]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 20:38:06 user nova-compute[71654]:   <vcpu placement='static'>1</vcpu>
Apr 11 20:38:06 user nova-compute[71654]:   <resource>
Apr 11 20:38:06 user nova-compute[71654]:     <partition>/machine</partition>
Apr 11 20:38:06 user nova-compute[71654]:   </resource>
Apr 11 20:38:06 user nova-compute[71654]:   <sysinfo type='smbios'>
Apr 11 20:38:06 user nova-compute[71654]:     <system>
Apr 11 20:38:06 user nova-compute[71654]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 20:38:06 user nova-compute[71654]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 20:38:06 user nova-compute[71654]:       <entry name='version'>0.0.0</entry>
Apr 11 20:38:06 user nova-compute[71654]:       <entry name='serial'>b7d2dbd0-544c-4146-b35c-125eef81c281</entry>
Apr 11 20:38:06 user nova-compute[71654]:       <entry name='uuid'>b7d2dbd0-544c-4146-b35c-125eef81c281</entry>
Apr 11 20:38:06 user nova-compute[71654]:       <entry name='family'>Virtual Machine</entry>
Apr 11 20:38:06 user nova-compute[71654]:     </system>
Apr 11 20:38:06 user nova-compute[71654]:   </sysinfo>
Apr 11 20:38:06 user nova-compute[71654]:   <os>
Apr 11 20:38:06 user nova-compute[71654]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 20:38:06 user nova-compute[71654]:     <boot dev='hd'/>
Apr 11 20:38:06 user nova-compute[71654]:     <smbios mode='sysinfo'/>
Apr 11 20:38:06 user nova-compute[71654]:   </os>
Apr 11 20:38:06 user nova-compute[71654]:   <features>
Apr 11 20:38:06 user nova-compute[71654]:     <acpi/>
Apr 11 20:38:06 user nova-compute[71654]:     <apic/>
Apr 11 20:38:06 user nova-compute[71654]:     <vmcoreinfo state='on'/>
Apr 11 20:38:06 user nova-compute[71654]:   </features>
Apr 11 20:38:06 user nova-compute[71654]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 20:38:06 user nova-compute[71654]:     <model fallback='forbid'>Nehalem</model>
Apr 11 20:38:06 user nova-compute[71654]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 20:38:06 user nova-compute[71654]:     <feature policy='require' name='vme'/>
Apr 11 20:38:06 user nova-compute[71654]:     <feature policy='require' name='x2apic'/>
Apr 11 20:38:06 user nova-compute[71654]:     <feature policy='require' name='hypervisor'/>
Apr 11 20:38:06 user nova-compute[71654]:   </cpu>
Apr 11 20:38:06 user nova-compute[71654]:   <clock offset='utc'>
Apr 11 20:38:06 user nova-compute[71654]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 20:38:06 user nova-compute[71654]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 20:38:06 user nova-compute[71654]:     <timer name='hpet' present='no'/>
Apr 11 20:38:06 user nova-compute[71654]:   </clock>
Apr 11 20:38:06 user nova-compute[71654]:   <on_poweroff>destroy</on_poweroff>
Apr 11 20:38:06 user nova-compute[71654]:   <on_reboot>restart</on_reboot>
Apr 11 20:38:06 user nova-compute[71654]:   <on_crash>destroy</on_crash>
Apr 11 20:38:06 user nova-compute[71654]:   <devices>
Apr 11 20:38:06 user nova-compute[71654]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 20:38:06 user nova-compute[71654]:     <disk type='file' device='disk'>
Apr 11 20:38:06 user nova-compute[71654]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 20:38:06 user nova-compute[71654]:       <source file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk' index='2'/>
Apr 11 20:38:06 user nova-compute[71654]:       <backingStore type='file' index='3'>
Apr 11 20:38:06 user nova-compute[71654]:         <format type='raw'/>
Apr 11 20:38:06 user nova-compute[71654]:         <source file='/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d'/>
Apr 11 20:38:06 user nova-compute[71654]:         <backingStore/>
Apr 11 20:38:06 user nova-compute[71654]:       </backingStore>
Apr 11 20:38:06 user nova-compute[71654]:       <target dev='vda' bus='virtio'/>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='virtio-disk0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </disk>
Apr 11 20:38:06 user nova-compute[71654]:     <disk type='file' device='cdrom'>
Apr 11 20:38:06 user nova-compute[71654]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 20:38:06 user nova-compute[71654]:       <source file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk.config' index='1'/>
Apr 11 20:38:06 user nova-compute[71654]:       <backingStore/>
Apr 11 20:38:06 user nova-compute[71654]:       <target dev='hda' bus='ide'/>
Apr 11 20:38:06 user nova-compute[71654]:       <readonly/>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='ide0-0-0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </disk>
Apr 11 20:38:06 user nova-compute[71654]:     <controller type='usb' index='0' model='none'>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='usb'/>
Apr 11 20:38:06 user nova-compute[71654]:     </controller>
Apr 11 20:38:06 user nova-compute[71654]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='pci.0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </controller>
Apr 11 20:38:06 user nova-compute[71654]:     <controller type='ide' index='0'>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='ide'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 20:38:06 user nova-compute[71654]:     </controller>
Apr 11 20:38:06 user nova-compute[71654]:     <interface type='ethernet'>
Apr 11 20:38:06 user nova-compute[71654]:       <mac address='fa:16:3e:12:92:b7'/>
Apr 11 20:38:06 user nova-compute[71654]:       <target dev='tap81fa518b-09'/>
Apr 11 20:38:06 user nova-compute[71654]:       <model type='virtio'/>
Apr 11 20:38:06 user nova-compute[71654]:       <mtu size='1442'/>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='net0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </interface>
Apr 11 20:38:06 user nova-compute[71654]:     <serial type='pty'>
Apr 11 20:38:06 user nova-compute[71654]:       <source path='/dev/pts/6'/>
Apr 11 20:38:06 user nova-compute[71654]:       <log file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/console.log' append='off'/>
Apr 11 20:38:06 user nova-compute[71654]:       <target type='isa-serial' port='0'>
Apr 11 20:38:06 user nova-compute[71654]:         <model name='isa-serial'/>
Apr 11 20:38:06 user nova-compute[71654]:       </target>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='serial0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </serial>
Apr 11 20:38:06 user nova-compute[71654]:     <console type='pty' tty='/dev/pts/6'>
Apr 11 20:38:06 user nova-compute[71654]:       <source path='/dev/pts/6'/>
Apr 11 20:38:06 user nova-compute[71654]:       <log file='/opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/console.log' append='off'/>
Apr 11 20:38:06 user nova-compute[71654]:       <target type='serial' port='0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='serial0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </console>
Apr 11 20:38:06 user nova-compute[71654]:     <input type='mouse' bus='ps2'>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='input0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </input>
Apr 11 20:38:06 user nova-compute[71654]:     <input type='keyboard' bus='ps2'>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='input1'/>
Apr 11 20:38:06 user nova-compute[71654]:     </input>
Apr 11 20:38:06 user nova-compute[71654]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 11 20:38:06 user nova-compute[71654]:       <listen type='address' address='0.0.0.0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </graphics>
Apr 11 20:38:06 user nova-compute[71654]:     <audio id='1' type='none'/>
Apr 11 20:38:06 user nova-compute[71654]:     <video>
Apr 11 20:38:06 user nova-compute[71654]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='video0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </video>
Apr 11 20:38:06 user nova-compute[71654]:     <memballoon model='virtio'>
Apr 11 20:38:06 user nova-compute[71654]:       <stats period='10'/>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='balloon0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </memballoon>
Apr 11 20:38:06 user nova-compute[71654]:     <rng model='virtio'>
Apr 11 20:38:06 user nova-compute[71654]:       <backend model='random'>/dev/urandom</backend>
Apr 11 20:38:06 user nova-compute[71654]:       <alias name='rng0'/>
Apr 11 20:38:06 user nova-compute[71654]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 20:38:06 user nova-compute[71654]:     </rng>
Apr 11 20:38:06 user nova-compute[71654]:   </devices>
Apr 11 20:38:06 user nova-compute[71654]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 20:38:06 user nova-compute[71654]:     <label>libvirt-b7d2dbd0-544c-4146-b35c-125eef81c281</label>
Apr 11 20:38:06 user nova-compute[71654]:     <imagelabel>libvirt-b7d2dbd0-544c-4146-b35c-125eef81c281</imagelabel>
Apr 11 20:38:06 user nova-compute[71654]:   </seclabel>
Apr 11 20:38:06 user nova-compute[71654]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 20:38:06 user nova-compute[71654]:     <label>+64055:+108</label>
Apr 11 20:38:06 user nova-compute[71654]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 20:38:06 user nova-compute[71654]:   </seclabel>
Apr 11 20:38:06 user nova-compute[71654]: </domain>
Apr 11 20:38:06 user nova-compute[71654]:  {{(pid=71654) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 20:38:06 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully detached device tap96808211-12 from instance b7d2dbd0-544c-4146-b35c-125eef81c281 from the live domain config.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "96808211-12b7-43cd-8ca0-02265ff49938", "address": "fa:16:3e:fb:15:5f", "network": {"id": "b525da5e-39db-4d91-a875-33ce571afeb7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1213946286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96808211-12", "ovs_interfaceid": "96808211-12b7-43cd-8ca0-02265ff49938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_vif [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96808211-12, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:06 user nova-compute[71654]: INFO os_vif [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:15:5f,bridge_name='br-int',has_traffic_filtering=True,id=96808211-12b7-43cd-8ca0-02265ff49938,network=Network(b525da5e-39db-4d91-a875-33ce571afeb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96808211-12')
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:38:06 user nova-compute[71654]:   <nova:package version="0.0.0"/>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:name>tempest-device-tagging-server-1083627248</nova:name>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:creationTime>2023-04-11 20:38:06</nova:creationTime>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:flavor name="m1.nano">
Apr 11 20:38:06 user nova-compute[71654]:     <nova:memory>128</nova:memory>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:disk>1</nova:disk>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:swap>0</nova:swap>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:vcpus>1</nova:vcpus>
Apr 11 20:38:06 user nova-compute[71654]:   </nova:flavor>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:owner>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:user uuid="05684678d0cd4ccea78238d20d561f3f">tempest-TaggedAttachmentsTest-1851174411-project-member</nova:user>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:project uuid="d40e31bd9e6e4d5e9cff3e4f2c1cf412">tempest-TaggedAttachmentsTest-1851174411</nova:project>
Apr 11 20:38:06 user nova-compute[71654]:   </nova:owner>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:38:06 user nova-compute[71654]:   <nova:ports>
Apr 11 20:38:06 user nova-compute[71654]:     <nova:port uuid="81fa518b-09cd-4072-b9be-2f74d2453d76">
Apr 11 20:38:06 user nova-compute[71654]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:38:06 user nova-compute[71654]:     </nova:port>
Apr 11 20:38:06 user nova-compute[71654]:   </nova:ports>
Apr 11 20:38:06 user nova-compute[71654]: </nova:instance>
Apr 11 20:38:06 user nova-compute[71654]:  {{(pid=71654) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-e31567ff-e573-4ed5-a006-bd58e4910906 for instance with vm_state active and task_state deleting.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-532c5436-45ba-4503-a774-4fa206ce6f73 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-be8db18f-3fd5-4d51-af9d-e55903d03f60 req-3a7086d5-b075-47d8-899e-29ad2c8418b4 service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-532c5436-45ba-4503-a774-4fa206ce6f73 for instance with vm_state active and task_state deleting.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Deleted allocations for instance 674a4347-8da2-4455-8e90-0fd358b5f696
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26338373866313561', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338373866313561', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.576s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lazy-loading 'flavor' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-33b1d7c0-166a-4aa9-92b4-5b7d16637dc2 for instance with vm_state active and task_state deleting.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-58994cba-fc42-41f3-9e7c-9d2c4048ba15 for instance with vm_state active and task_state deleting.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-unplugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-unplugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "531a0692-eac9-4ac7-95dd-abb138512f30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] No waiting events found dispatching network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received unexpected event network-vif-plugged-c8d0aab1-4380-41a7-aeb6-3222168c5c52 for instance with vm_state active and task_state deleting.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-unplugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-unplugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-unplugged-96808211-12b7-43cd-8ca0-02265ff49938 for instance with vm_state active and task_state None.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:06 user nova-compute[71654]: WARNING nova.compute.manager [req-cb68bc2a-ea09-4b2d-89d1-3632c558a7d4 req-c86e97db-8192-4c43-9281-b1b815e2eb8f service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-plugged-96808211-12b7-43cd-8ca0-02265ff49938 for instance with vm_state active and task_state None.
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00516c-9261-4ede-a151-2c0af854166e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:06 user nova-compute[71654]: No targets found.
Apr 11 20:38:06 user nova-compute[71654]: iSNS:
Apr 11 20:38:06 user nova-compute[71654]: No targets found.
Apr 11 20:38:06 user nova-compute[71654]: STATIC:
Apr 11 20:38:06 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127
Apr 11 20:38:06 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:06 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:06 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:06 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:06 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:06 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:38:06 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:06 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:06 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:38:06 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:06 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:06 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:38:06 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:06 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:06 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:06 user nova-compute[71654]: No targets found.
Apr 11 20:38:06 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:06 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:06 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2933a950-c681-4697-af90-46c0e7609cfd tempest-AttachSCSIVolumeTestJSON-1026499087 tempest-AttachSCSIVolumeTestJSON-1026499087-project-member] Lock "674a4347-8da2-4455-8e90-0fd358b5f696" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.273s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba218fe-5056-4987-b6b7-1b4ee1965b9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d3a01-42ea-4f42-8dee-f66ff27c78ce]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:06 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:06 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb403fb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde556e1-e83c-4119-a9ba-2bbfc7667933]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c45c79-af46-422d-9584-1b887edaac01]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[87928c5f-455b-4761-8107-ac85646ccb1c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2006124b-7a7b-49a6-a554-1a11d9388735]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa160f8-d687-457e-85e3-bed2e6d2fbcb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquired lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b2a7a-c2e4-4ca4-9ee1-11d7e3c6364d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260]
Apr 11 20:38:07 user nova-compute[71654]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b934599-7ca8-4454-92c2-a16987271127 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d376d-e1e9-4d9e-935b-b082bf89021a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== disconnect_volume: return (943ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuiTFgOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:07 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de29b4-2598-475f-b2d9-57b064404289]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:07 user nova-compute[71654]: No targets found.
Apr 11 20:38:07 user nova-compute[71654]: iSNS:
Apr 11 20:38:07 user nova-compute[71654]: No targets found.
Apr 11 20:38:07 user nova-compute[71654]: STATIC:
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:07 user nova-compute[71654]: No targets found.
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:07 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:07 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab228f8d-1d22-4cf0-989a-ddcc8d2dcde7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21e8f41-4cf2-4a70-8c37-24f16ec28ce7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb4073e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[561ce275-af23-4f31-a41f-65c0295c3a10]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca301682-fe55-4e0f-be3b-94861e6cb4d0]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7cfaa3-9f3a-4480-b983-ac584413a377]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[00099e12-d9af-453a-bed4-89285bd57153]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c244b-97d8-4221-abe0-b4296f43edc5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[23676e06-9aba-444a-aaff-e3f7b4db2a7a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260]
Apr 11 20:38:07 user nova-compute[71654]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97768c05-bc64-4bf6-83ae-4350d75b7320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77e3df8-c817-49ec-958b-6fc89858e5bb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== disconnect_volume: return (379ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXEdfJPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:07 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e2708-88f5-4262-8196-3fda75047226]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:07 user nova-compute[71654]: No targets found.
Apr 11 20:38:07 user nova-compute[71654]: iSNS:
Apr 11 20:38:07 user nova-compute[71654]: No targets found.
Apr 11 20:38:07 user nova-compute[71654]: STATIC:
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba
Apr 11 20:38:07 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:07 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:07 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:07 user nova-compute[71654]: No targets found.
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:07 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:07 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffac0879-22c9-4177-9d8d-1c12a525224e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cc39ac-347b-4d7f-8f1d-fc93285f5ddf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba (non-flash)
Apr 11 20:38:07 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e7fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ce6c0f-4d48-4d13-b487-847b5c3aab62]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67bd55d-b667-4339-bb6d-f42dc4538701]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[27537656-9f16-4229-8e78-5e0c8609697e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:07 user nova-compute[71654]: INFO nova.network.neutron [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Port 96808211-12b7-43cd-8ca0-02265ff49938 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [{"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffeb04a-4ccf-4b40-864f-bd69c08e824b]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Releasing lock "refresh_cache-b7d2dbd0-544c-4146-b35c-125eef81c281" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34eb83-390c-4098-8709-64576acd8052]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-4dfefc93-9c79-463d-8465-f727997d2a94 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "interface-b7d2dbd0-544c-4146-b35c-125eef81c281-96808211-12b7-43cd-8ca0-02265ff49938" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.015s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[363502e7-43cb-4388-ac48-46721538562d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260]
Apr 11 20:38:07 user nova-compute[71654]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca36a125-7c79-4bf4-8c28-9d1b798dceba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55c79dd-b5a1-4b8e-bde2-f491cc39c992]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] <== disconnect_volume: return (381ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Deleting instance files /opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30_del
Apr 11 20:38:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Deletion of /opt/stack/data/nova/instances/531a0692-eac9-4ac7-95dd-abb138512f30_del complete
Apr 11 20:38:07 user nova-compute[71654]: INFO nova.compute.manager [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Took 3.97 seconds to destroy the instance on the hypervisor.
Apr 11 20:38:07 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Received event network-vif-deleted-4bad185c-c76d-4162-8213-384229da15ca {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-b0d56381-e4bc-417d-a9ba-5576be566dc0 req-f71e1eca-9dfb-406e-816b-63b4e2618986 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-deleted-96808211-12b7-43cd-8ca0-02265ff49938 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 355467264 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 511705088 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 682622976 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 868220928 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:09 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-deleted-58994cba-fc42-41f3-9e7c-9d2c4048ba15 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:10 user nova-compute[71654]: INFO nova.compute.manager [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Neutron deleted interface 58994cba-fc42-41f3-9e7c-9d2c4048ba15; detaching it from the instance and deleting it from the info cache
Apr 11 20:38:10 user nova-compute[71654]: DEBUG nova.network.neutron [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [{"id": "e31567ff-e573-4ed5-a006-bd58e4910906", "address": "fa:16:3e:b9:80:21", "network": {"id": "4bd0e6c3-35c1-4e52-aa48-bebac03add01", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-943512894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31567ff-e5", "ovs_interfaceid": "e31567ff-e573-4ed5-a006-bd58e4910906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "address": "fa:16:3e:0f:b0:ca", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb7820c-fc", "ovs_interfaceid": "1bb7820c-fce7-4d0d-8d4c-4d506f0db38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "address": "fa:16:3e:50:dd:2f", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b1d7c0-16", "ovs_interfaceid": "33b1d7c0-166a-4aa9-92b4-5b7d16637dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "532c5436-45ba-4503-a774-4fa206ce6f73", "address": "fa:16:3e:f4:55:46", "network": {"id": "1132fd57-4fb8-42ff-b70e-665ae0200cda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424040551", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532c5436-45", "ovs_interfaceid": "532c5436-45ba-4503-a774-4fa206ce6f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "address": "fa:16:3e:dd:9c:3c", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2279246f-00", "ovs_interfaceid": "2279246f-00a6-4589-b12c-ca5ab19d54a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "address": "fa:16:3e:22:ff:a0", "network": {"id": "37c1d133-c3f1-4bd5-8af7-85380cc64d85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1160026914", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "caa968f4c38c40719e6169250097c718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d0aab1-43", "ovs_interfaceid": "c8d0aab1-4380-41a7-aeb6-3222168c5c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd8ef971-5cd5-47f3-aa85-d752053aca98 req-2bd536fa-00eb-4ee4-b446-c91d00324a9d service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Detach interface failed, port_id=58994cba-fc42-41f3-9e7c-9d2c4048ba15, reason: Instance 531a0692-eac9-4ac7-95dd-abb138512f30 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 1047527424 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbDlXHej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'b5508baa-4461-4b70-9b47-f0414d386013': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:10 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96c504-5a0d-4b47-a64d-9401993765d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:10 user nova-compute[71654]: No targets found.
Apr 11 20:38:10 user nova-compute[71654]: iSNS:
Apr 11 20:38:10 user nova-compute[71654]: No targets found.
Apr 11 20:38:10 user nova-compute[71654]: STATIC:
Apr 11 20:38:10 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:10 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:10 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:10 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013
Apr 11 20:38:10 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:10 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:10 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:10 user nova-compute[71654]: No targets found.
Apr 11 20:38:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:10 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:10 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6c79a9-e8ad-41f3-89e8-85268d88762c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a5b419-486f-45b0-b03e-685407b9c946]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:10 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:10 user nova-compute[71654]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 (non-flash)
Apr 11 20:38:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e7e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013'): ({'sdg'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Removing single pathed devices sdg {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d91b116-f0a2-43f7-9272-a988865fc581]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6378911b-e986-438b-9207-e24fe66753dd]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Flushing IO for device /dev/sdg {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[37718f45-5ce9-4f4a-bda5-1cb56e76dd67]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec37037d-dfb6-4e0c-a139-59f42ca38b9c]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] SCSI volumes sdg have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[89068ea5-751e-4f24-b4e4-08d6000d40b6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7abe5e4-5ae0-4d30-890b-9c59dcbebdc4]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260]
Apr 11 20:38:11 user nova-compute[71654]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5508baa-4461-4b70-9b47-f0414d386013 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafc284c-4aea-4a24-b531-94520b45300a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] <== disconnect_volume: return (291ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cafd98ea-fe9e-4159-a454-6833bdcb8934', 'attached_at': '', 'detached_at': '', 'volume_id': '54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'serial'} {{(pid=71654) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] swap_volume: removing Cinder connection for volume b5508baa-4461-4b70-9b47-f0414d386013 {{(pid=71654) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:38:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] swap_volume: Updating volume b5508baa-4461-4b70-9b47-f0414d386013 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aMghAGbc", "auth_password": "CYOcHFnsk012re", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "54c1df9d-22e1-4a3b-a9f9-8200f8463170"}, "status": "reserved", "instance": "cafd98ea-fe9e-4159-a454-6833bdcb8934", "attached_at": "", "detached_at": "", "volume_id": "54c1df9d-22e1-4a3b-a9f9-8200f8463170", "serial": "54c1df9d-22e1-4a3b-a9f9-8200f8463170"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'no_device': None, 'attachment_id': '1d6f6982-6692-42e6-8834-0949acdae9df'} {{(pid=71654) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2bfbd69d-a3a3-45d7-baa5-5d4ab993e271 tempest-TestVolumeSwap-1795997392 tempest-TestVolumeSwap-1795997392-project-admin] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.978s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:12 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Took 4.15 seconds to deallocate network for instance.
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-deleted-c8d0aab1-4380-41a7-aeb6-3222168c5c52 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-deleted-2279246f-00a6-4589-b12c-ca5ab19d54a7 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-deleted-e31567ff-e573-4ed5-a006-bd58e4910906 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-e9bfb864-70c0-4db6-a4e2-465d68811a02 req-ed1c4f09-9b99-4f74-8c8e-a574ca5f5c4b service nova] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Received event network-vif-deleted-532c5436-45ba-4503-a774-4fa206ce6f73 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:12 user nova-compute[71654]: INFO nova.compute.manager [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Detaching volume 54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:12 user nova-compute[71654]: INFO nova.virt.block_device [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Attempting to driver detach volume 54c1df9d-22e1-4a3b-a9f9-8200f8463170 from mountpoint /dev/vdb
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Attempting to detach device vdb from instance cafd98ea-fe9e-4159-a454-6833bdcb8934 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:38:12 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:38:12 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:38:12 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:38:12 user nova-compute[71654]:   <serial>54c1df9d-22e1-4a3b-a9f9-8200f8463170</serial>
Apr 11 20:38:12 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:38:12 user nova-compute[71654]: </disk>
Apr 11 20:38:12 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:38:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Successfully detached device vdb from instance cafd98ea-fe9e-4159-a454-6833bdcb8934 from the persistent domain config.
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cafd98ea-fe9e-4159-a454-6833bdcb8934 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:38:12 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:38:12 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:38:12 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:38:12 user nova-compute[71654]:   <serial>54c1df9d-22e1-4a3b-a9f9-8200f8463170</serial>
Apr 11 20:38:12 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:38:12 user nova-compute[71654]: </disk>
Apr 11 20:38:12 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245493.1228743, cafd98ea-fe9e-4159-a454-6833bdcb8934 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:38:13 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Successfully detached device vdb from instance cafd98ea-fe9e-4159-a454-6833bdcb8934 from the live domain config.
Apr 11 20:38:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMghAGbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '54c1df9d-22e1-4a3b-a9f9-8200f8463170': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:38:13 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492da3d-e54f-4f3e-be40-606218093218]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:38:13 user nova-compute[71654]: No targets found.
Apr 11 20:38:13 user nova-compute[71654]: iSNS:
Apr 11 20:38:13 user nova-compute[71654]: No targets found.
Apr 11 20:38:13 user nova-compute[71654]: STATIC:
Apr 11 20:38:13 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170
Apr 11 20:38:13 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:38:13 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:38:13 user nova-compute[71654]: FIRMWARE:
Apr 11 20:38:13 user nova-compute[71654]: No targets found.
Apr 11 20:38:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:38:13 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:38:13 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76b3dd-9425-4093-9919-7710faf0645c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b26ba-edbd-4784-b5ba-74810029b589]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 (non-flash)
Apr 11 20:38:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb40759990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[887882cc-0d9a-4f37-86e0-bbfd425e4cdd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9e93f-dc0f-4d5c-9b35-0312ca8de4db]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[23afec18-e6ee-45e7-873e-0667a66aca72]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d070c0-3555-456e-9f64-c2fd4f617e5e]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[84900d67-8625-4896-b152-89ff00ea123c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e321235d-1311-4720-8123-d63b5d5e694c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260]
Apr 11 20:38:13 user nova-compute[71654]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170, portal: 172.16.0.220,3260] successful.
Apr 11 20:38:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c1df9d-22e1-4a3b-a9f9-8200f8463170 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f4d4ba-632f-4d32-9286-8ddaea64ce05]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] <== disconnect_volume: return (311ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:13 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'flavor' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a0d426b6-8245-420e-a56c-06471fe576a2 tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.815s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:14 user nova-compute[71654]: INFO nova.compute.manager [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Took 2.43 seconds to detach 3 volumes for instance.
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:38:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Deleted allocations for instance 531a0692-eac9-4ac7-95dd-abb138512f30
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c898861d-5047-4c7b-8a40-d3917980c739 tempest-TaggedBootDevicesTest-1812283911 tempest-TaggedBootDevicesTest-1812283911-project-member] Lock "531a0692-eac9-4ac7-95dd-abb138512f30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.204s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:16 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:38:16 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=26.656036376953125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance cafd98ea-fe9e-4159-a454-6833bdcb8934 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b7d2dbd0-544c-4146-b35c-125eef81c281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:38:16 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:38:17 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:38:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:38:19 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245484.253103, 674a4347-8da2-4455-8e90-0fd358b5f696 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:38:19 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] VM Stopped (Lifecycle Event)
Apr 11 20:38:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b8c7cc2c-1680-401a-a839-774bb7e0e93a None None] [instance: 674a4347-8da2-4455-8e90-0fd358b5f696] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:38:20 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245485.733686, 531a0692-eac9-4ac7-95dd-abb138512f30 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:38:20 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] VM Stopped (Lifecycle Event)
Apr 11 20:38:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-0fe2d3d1-abbe-45ec-9b86-d5a24b16fceb None None] [instance: 531a0692-eac9-4ac7-95dd-abb138512f30] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:38:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:38:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:38:42 user nova-compute[71654]: INFO nova.compute.claims [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Claim successful on node user
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:38:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.policy [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af25924dd6564739a52fd957edceb143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ab02b2eef8d40f18b755b63d2a14c9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:38:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Creating image(s)
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "/opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "/opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "/opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk 1073741824" returned: 0 in 0.047s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:38:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Cannot resize image /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'migration_context' on Instance uuid 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Ensure instance console log exists: /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Successfully created port: c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Successfully updated port: c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "refresh_cache-44b8fa17-6b3b-42ea-84ee-06a9beca49b4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquired lock "refresh_cache-44b8fa17-6b3b-42ea-84ee-06a9beca49b4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-changed-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Refreshing instance network info cache due to event network-changed-c0443e27-a70c-4bb3-8650-ffe89cbb9c59. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Acquiring lock "refresh_cache-44b8fa17-6b3b-42ea-84ee-06a9beca49b4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Updating instance_info_cache with network_info: [{"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Releasing lock "refresh_cache-44b8fa17-6b3b-42ea-84ee-06a9beca49b4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Instance network_info: |[{"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Acquired lock "refresh_cache-44b8fa17-6b3b-42ea-84ee-06a9beca49b4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.neutron [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Refreshing network info cache for port c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Start _get_guest_xml network_info=[{"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:38:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:38:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-566404294',display_name='tempest-VolumesAdminNegativeTest-server-566404294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-566404294',id=10,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab02b2eef8d40f18b755b63d2a14c9b',ramdisk_id='',reservation_id='r-y29x06xp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-878898162',owner_user_name='tempest-VolumesAdminNegativeTest-878898162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:38:43Z,user_data=None,user_id='af25924dd6564739a52fd957edceb143',uuid=44b8fa17-6b3b-42ea-84ee-06a9beca49b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converting VIF {"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'pci_devices' on Instance uuid 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:38:45 user nova-compute[71654]:   <uuid>44b8fa17-6b3b-42ea-84ee-06a9beca49b4</uuid>
Apr 11 20:38:45 user nova-compute[71654]:   <name>instance-0000000a</name>
Apr 11 20:38:45 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:38:45 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:38:45 user nova-compute[71654]:   <metadata>
Apr 11 20:38:45 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:38:45 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:38:45 user nova-compute[71654]:       <nova:name>tempest-VolumesAdminNegativeTest-server-566404294</nova:name>
Apr 11 20:38:45 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:38:45</nova:creationTime>
Apr 11 20:38:45 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:38:45 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:38:45 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:38:45 user nova-compute[71654]:       <nova:owner>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:user uuid="af25924dd6564739a52fd957edceb143">tempest-VolumesAdminNegativeTest-878898162-project-member</nova:user>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:project uuid="0ab02b2eef8d40f18b755b63d2a14c9b">tempest-VolumesAdminNegativeTest-878898162</nova:project>
Apr 11 20:38:45 user nova-compute[71654]:       </nova:owner>
Apr 11 20:38:45 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:38:45 user nova-compute[71654]:       <nova:ports>
Apr 11 20:38:45 user nova-compute[71654]:         <nova:port uuid="c0443e27-a70c-4bb3-8650-ffe89cbb9c59">
Apr 11 20:38:45 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:38:45 user nova-compute[71654]:         </nova:port>
Apr 11 20:38:45 user nova-compute[71654]:       </nova:ports>
Apr 11 20:38:45 user nova-compute[71654]:     </nova:instance>
Apr 11 20:38:45 user nova-compute[71654]:   </metadata>
Apr 11 20:38:45 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:38:45 user nova-compute[71654]:     <system>
Apr 11 20:38:45 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:38:45 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:38:45 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:38:45 user nova-compute[71654]:       <entry name="serial">44b8fa17-6b3b-42ea-84ee-06a9beca49b4</entry>
Apr 11 20:38:45 user nova-compute[71654]:       <entry name="uuid">44b8fa17-6b3b-42ea-84ee-06a9beca49b4</entry>
Apr 11 20:38:45 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:38:45 user nova-compute[71654]:     </system>
Apr 11 20:38:45 user nova-compute[71654]:   </sysinfo>
Apr 11 20:38:45 user nova-compute[71654]:   <os>
Apr 11 20:38:45 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:38:45 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:38:45 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:38:45 user nova-compute[71654]:   </os>
Apr 11 20:38:45 user nova-compute[71654]:   <features>
Apr 11 20:38:45 user nova-compute[71654]:     <acpi/>
Apr 11 20:38:45 user nova-compute[71654]:     <apic/>
Apr 11 20:38:45 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:38:45 user nova-compute[71654]:   </features>
Apr 11 20:38:45 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:38:45 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:38:45 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:38:45 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:38:45 user nova-compute[71654]:   </clock>
Apr 11 20:38:45 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:38:45 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:38:45 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:38:45 user nova-compute[71654]:   </cpu>
Apr 11 20:38:45 user nova-compute[71654]:   <devices>
Apr 11 20:38:45 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:38:45 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:38:45 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk"/>
Apr 11 20:38:45 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:38:45 user nova-compute[71654]:     </disk>
Apr 11 20:38:45 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:38:45 user nova-compute[71654]:       <mac address="fa:16:3e:14:13:1a"/>
Apr 11 20:38:45 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:38:45 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:38:45 user nova-compute[71654]:       <target dev="tapc0443e27-a7"/>
Apr 11 20:38:45 user nova-compute[71654]:     </interface>
Apr 11 20:38:45 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:38:45 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/console.log" append="off"/>
Apr 11 20:38:45 user nova-compute[71654]:     </serial>
Apr 11 20:38:45 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:38:45 user nova-compute[71654]:     <video>
Apr 11 20:38:45 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:38:45 user nova-compute[71654]:     </video>
Apr 11 20:38:45 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:38:45 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:38:45 user nova-compute[71654]:     </rng>
Apr 11 20:38:45 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:38:45 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:38:45 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:38:45 user nova-compute[71654]:     </memballoon>
Apr 11 20:38:45 user nova-compute[71654]:   </devices>
Apr 11 20:38:45 user nova-compute[71654]: </domain>
Apr 11 20:38:45 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-566404294',display_name='tempest-VolumesAdminNegativeTest-server-566404294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-566404294',id=10,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ab02b2eef8d40f18b755b63d2a14c9b',ramdisk_id='',reservation_id='r-y29x06xp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-878898162',owner_user_name='tempest-VolumesAdminNegativeTest-878898162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:38:43Z,user_data=None,user_id='af25924dd6564739a52fd957edceb143',uuid=44b8fa17-6b3b-42ea-84ee-06a9beca49b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converting VIF {"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG os_vif [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0443e27-a7, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0443e27-a7, col_values=(('external_ids', {'iface-id': 'c0443e27-a70c-4bb3-8650-ffe89cbb9c59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:13:1a', 'vm-uuid': '44b8fa17-6b3b-42ea-84ee-06a9beca49b4'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:45 user nova-compute[71654]: INFO os_vif [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7')
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:38:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] No VIF found with MAC fa:16:3e:14:13:1a, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:38:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Updated VIF entry in instance network info cache for port c0443e27-a70c-4bb3-8650-ffe89cbb9c59. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:38:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Updating instance_info_cache with network_info: [{"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cea29278-7f37-4f33-ab72-0e40384b956d req-fa9fa20c-9283-47c5-b2d7-9d669f50d4a4 service nova] Releasing lock "refresh_cache-44b8fa17-6b3b-42ea-84ee-06a9beca49b4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] No waiting events found dispatching network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:47 user nova-compute[71654]: WARNING nova.compute.manager [req-9e20836e-eae8-458e-874e-eb636a077547 req-12e39b4f-d108-44d0-a464-a9971ebc3082 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received unexpected event network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance with vm_state building and task_state spawning.
Apr 11 20:38:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245529.2561197, 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] VM Resumed (Lifecycle Event)
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Instance spawned successfully.
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245529.260765, 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] VM Started (Lifecycle Event)
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Took 6.03 seconds to spawn the instance on the hypervisor.
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] No waiting events found dispatching network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:49 user nova-compute[71654]: WARNING nova.compute.manager [req-4edb11e3-e4f7-46b4-80e0-ba51156a061d req-eb63a723-fe00-4831-baaa-f10755bd1d3b service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received unexpected event network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance with vm_state building and task_state spawning.
Apr 11 20:38:49 user nova-compute[71654]: INFO nova.compute.manager [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Took 6.68 seconds to build instance.
Apr 11 20:38:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c31fad87-5af0-4ff8-a0a8-70311b48e0e4 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.783s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:56 user nova-compute[71654]: INFO nova.compute.manager [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Terminating instance
Apr 11 20:38:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-unplugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-unplugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-df51fe18-4802-463f-b766-2558d5bb872c req-bf9276b6-a388-4485-8855-c28cbc2e044c service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-unplugged-81fa518b-09cd-4072-b9be-2f74d2453d76 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:57 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Instance destroyed successfully.
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lazy-loading 'resources' on Instance uuid b7d2dbd0-544c-4146-b35c-125eef81c281 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1083627248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1083627248',id=7,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwduZKcl6r5JW1qJdnJJTK2rLOHoiOLdAC4SPnsgSWlkMI4BDBDdqTm4yLi003c5AVggWdq0sCuQa1murYvCXOq/3pouVJhx0IEyNICnvvNNS+Cvbn1a7l6wnEOF2EGg==',key_name='tempest-keypair-1400889989',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e31bd9e6e4d5e9cff3e4f2c1cf412',ramdisk_id='',reservation_id='r-kuu47xev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1851174411',owner_user_name='tempest-TaggedAttachmentsTest-1851174411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05684678d0cd4ccea78238d20d561f3f',uuid=b7d2dbd0-544c-4146-b35c-125eef81c281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converting VIF {"id": "81fa518b-09cd-4072-b9be-2f74d2453d76", "address": "fa:16:3e:12:92:b7", "network": {"id": "f0dacc75-df3d-48cd-ac8f-1179c035c013", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-624989024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e31bd9e6e4d5e9cff3e4f2c1cf412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81fa518b-09", "ovs_interfaceid": "81fa518b-09cd-4072-b9be-2f74d2453d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG os_vif [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81fa518b-09, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:38:57 user nova-compute[71654]: INFO os_vif [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:92:b7,bridge_name='br-int',has_traffic_filtering=True,id=81fa518b-09cd-4072-b9be-2f74d2453d76,network=Network(f0dacc75-df3d-48cd-ac8f-1179c035c013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81fa518b-09')
Apr 11 20:38:57 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Deleting instance files /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281_del
Apr 11 20:38:57 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Deletion of /opt/stack/data/nova/instances/b7d2dbd0-544c-4146-b35c-125eef81c281_del complete
Apr 11 20:38:57 user nova-compute[71654]: INFO nova.compute.manager [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 11 20:38:57 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:38:57 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:38:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:38:58 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:38:58 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Took 1.30 seconds to deallocate network for instance.
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Acquiring lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] No waiting events found dispatching network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:38:59 user nova-compute[71654]: WARNING nova.compute.manager [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received unexpected event network-vif-plugged-81fa518b-09cd-4072-b9be-2f74d2453d76 for instance with vm_state deleted and task_state None.
Apr 11 20:38:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-116ec7db-ba53-4b40-84c3-145ebfee0e87 req-95c45d36-d443-480f-8921-5ed8de610ea6 service nova] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Received event network-vif-deleted-81fa518b-09cd-4072-b9be-2f74d2453d76 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:38:59 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Deleted allocations for instance b7d2dbd0-544c-4146-b35c-125eef81c281
Apr 11 20:38:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dd1254f9-d4af-45a7-8009-e987ed067956 tempest-TaggedAttachmentsTest-1851174411 tempest-TaggedAttachmentsTest-1851174411-project-member] Lock "b7d2dbd0-544c-4146-b35c-125eef81c281" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:02 user nova-compute[71654]: INFO nova.compute.manager [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Terminating instance
Apr 11 20:39:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-vif-unplugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] No waiting events found dispatching network-vif-unplugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-a72fb468-bac3-4a87-85aa-947281431862 req-d6980024-4b73-4c69-b557-025a7269cc43 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-vif-unplugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:39:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Instance destroyed successfully.
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lazy-loading 'resources' on Instance uuid cafd98ea-fe9e-4159-a454-6833bdcb8934 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-717469447',display_name='tempest-TestVolumeSwap-server-717469447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-717469447',id=5,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHMuKtVqAgzsp5/expcX1bSxUaW1NpVgPU1mtUX80BTfPGihWz8OjN8J0Als+77YSgxutHOeytPJue1OlY4uegNXWVZVzcmOsVm9ZJdBkbHsA7NF/lHdxwZKph7epnUIA==',key_name='tempest-keypair-208847137',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f2a37d13cdd4a8f90c4cd205d4f8b76',ramdisk_id='',reservation_id='r-fv2k4ei8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-384933576',owner_user_name='tempest-TestVolumeSwap-384933576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f180b6f746141ae9e52234fd8804b29',uuid=cafd98ea-fe9e-4159-a454-6833bdcb8934,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Converting VIF {"id": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "address": "fa:16:3e:6d:16:ca", "network": {"id": "41ed6326-30da-42e7-bb95-82da2c779cb8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1989527676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f2a37d13cdd4a8f90c4cd205d4f8b76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa6ccbf-2c", "ovs_interfaceid": "4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG os_vif [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aa6ccbf-2c, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:39:03 user nova-compute[71654]: INFO os_vif [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:16:ca,bridge_name='br-int',has_traffic_filtering=True,id=4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6,network=Network(41ed6326-30da-42e7-bb95-82da2c779cb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa6ccbf-2c')
Apr 11 20:39:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Deleting instance files /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934_del
Apr 11 20:39:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Deletion of /opt/stack/data/nova/instances/cafd98ea-fe9e-4159-a454-6833bdcb8934_del complete
Apr 11 20:39:03 user nova-compute[71654]: INFO nova.compute.manager [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 20:39:03 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:39:03 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:04 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Took 0.76 seconds to deallocate network for instance.
Apr 11 20:39:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:04 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Deleted allocations for instance cafd98ea-fe9e-4159-a454-6833bdcb8934
Apr 11 20:39:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a4eb15ee-21b2-40f8-9ee0-35e6b91cab5b tempest-TestVolumeSwap-384933576 tempest-TestVolumeSwap-384933576-project-member] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Acquiring lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] Lock "cafd98ea-fe9e-4159-a454-6833bdcb8934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] No waiting events found dispatching network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:05 user nova-compute[71654]: WARNING nova.compute.manager [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received unexpected event network-vif-plugged-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 for instance with vm_state deleted and task_state None.
Apr 11 20:39:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-e16be1a9-bbd2-4be3-b7c2-08bcde479583 req-3fbfca92-7c7d-4229-bd3c-52dfb0d8eb38 service nova] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Received event network-vif-deleted-4aa6ccbf-2cbf-43a8-bf6a-72f6b07b90f6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:39:11 user nova-compute[71654]: INFO nova.compute.claims [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Claim successful on node user
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:39:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:39:11 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.policy [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:39:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Creating image(s)
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "bfd505b2d93b327add2fad14956572f211308609" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "bfd505b2d93b327add2fad14956572f211308609" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245537.5186307, b7d2dbd0-544c-4146-b35c-125eef81c281 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:12 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] VM Stopped (Lifecycle Event)
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-44b42ccb-d48f-45a8-a688-c969bbef98d9 None None] [instance: b7d2dbd0-544c-4146-b35c-125eef81c281] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.part --force-share --output=json" returned: 0 in 0.171s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.virt.images [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 34247816-448f-4660-9d3b-31800b7e69d9 was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.part /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'flavor' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.part /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.converted" returned: 0 in 0.155s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Successfully created port: cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.134s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "bfd505b2d93b327add2fad14956572f211308609" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.863s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:13 user nova-compute[71654]: INFO nova.compute.manager [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attaching volume 9482e06e-2cf5-4af8-b281-e43941df6b7c to /dev/vdb
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "bfd505b2d93b327add2fad14956572f211308609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "bfd505b2d93b327add2fad14956572f211308609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a80112-ed1e-4edc-9ce5-6ce13e2c7eed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e8cfb4-1c50-4705-9cc0-13180aff6ff2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d892cc-026b-4fac-9d94-9327fe24f311]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b443b64-c326-4723-ac8e-708811b3f3aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json" returned: 0 in 0.163s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609,backing_fmt=raw /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:13 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a505f-9bd9-4d56-8f22-c36decd26962]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating existing volume attachment record: ffc6b610-57ee-4e5b-9a79-6be905835d78 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609,backing_fmt=raw /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk 1073741824" returned: 0 in 0.064s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "bfd505b2d93b327add2fad14956572f211308609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Cannot resize image /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'migration_context' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Ensure instance console log exists: /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:13 user nova-compute[71654]: INFO nova.compute.manager [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Unshelving
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Successfully updated port: cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing instance network info cache due to event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:13 user nova-compute[71654]: INFO nova.virt.block_device [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Booting with volume ac687e43-f85e-48a9-bbbe-69afaba2ec38 at /dev/vdc
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405ef79-ed5b-4b3b-8858-45b60aa8c9b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c462d108-2edc-4ddf-a5ce-f745f79344da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a76691-00ca-4209-993c-70c5c737ea0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10a40f-07a9-4901-bf20-ac3e54038f27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:39:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:14 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2441be-d6b2-4281-bc6c-a89b9958fa68]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG os_brick.utils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating existing volume attachment record: 92bab3ae-30b5-4562-aec3-111e04f18696 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance network_info: |[{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Start _get_guest_xml network_info=[{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:39:09Z,direct_url=<?>,disk_format='qcow2',id=34247816-448f-4660-9d3b-31800b7e69d9,min_disk=0,min_ram=0,name='tempest-scenario-img--105652788',owner='cdd62a4c803247588716e71c25c62b05',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:39:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '34247816-448f-4660-9d3b-31800b7e69d9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:39:09Z,direct_url=<?>,disk_format='qcow2',id=34247816-448f-4660-9d3b-31800b7e69d9,min_disk=0,min_ram=0,name='tempest-scenario-img--105652788',owner='cdd62a4c803247588716e71c25c62b05',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:39:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1961006747',display_name='tempest-TestMinimumBasicScenario-server-1961006747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1961006747',id=11,image_ref='34247816-448f-4660-9d3b-31800b7e69d9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ==',key_name='tempest-TestMinimumBasicScenario-338876043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-7jdekc70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34247816-448f-4660-9d3b-31800b7e69d9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:12Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=6af82381-69fc-47e5-a16f-cea88c569240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'pci_devices' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:39:14 user nova-compute[71654]:   <uuid>6af82381-69fc-47e5-a16f-cea88c569240</uuid>
Apr 11 20:39:14 user nova-compute[71654]:   <name>instance-0000000b</name>
Apr 11 20:39:14 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:39:14 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:39:14 user nova-compute[71654]:   <metadata>
Apr 11 20:39:14 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:39:14 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:39:14 user nova-compute[71654]:       <nova:name>tempest-TestMinimumBasicScenario-server-1961006747</nova:name>
Apr 11 20:39:14 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:39:14</nova:creationTime>
Apr 11 20:39:14 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:39:14 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:39:14 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:39:14 user nova-compute[71654]:       <nova:owner>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:user uuid="0a70ed7ce13442e6b7f6f62b960520ad">tempest-TestMinimumBasicScenario-2142191059-project-member</nova:user>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:project uuid="cdd62a4c803247588716e71c25c62b05">tempest-TestMinimumBasicScenario-2142191059</nova:project>
Apr 11 20:39:14 user nova-compute[71654]:       </nova:owner>
Apr 11 20:39:14 user nova-compute[71654]:       <nova:root type="image" uuid="34247816-448f-4660-9d3b-31800b7e69d9"/>
Apr 11 20:39:14 user nova-compute[71654]:       <nova:ports>
Apr 11 20:39:14 user nova-compute[71654]:         <nova:port uuid="cff9d1b4-18f3-4450-8d38-f230812fb66e">
Apr 11 20:39:14 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:39:14 user nova-compute[71654]:         </nova:port>
Apr 11 20:39:14 user nova-compute[71654]:       </nova:ports>
Apr 11 20:39:14 user nova-compute[71654]:     </nova:instance>
Apr 11 20:39:14 user nova-compute[71654]:   </metadata>
Apr 11 20:39:14 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:39:14 user nova-compute[71654]:     <system>
Apr 11 20:39:14 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:39:14 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:39:14 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:39:14 user nova-compute[71654]:       <entry name="serial">6af82381-69fc-47e5-a16f-cea88c569240</entry>
Apr 11 20:39:14 user nova-compute[71654]:       <entry name="uuid">6af82381-69fc-47e5-a16f-cea88c569240</entry>
Apr 11 20:39:14 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:39:14 user nova-compute[71654]:     </system>
Apr 11 20:39:14 user nova-compute[71654]:   </sysinfo>
Apr 11 20:39:14 user nova-compute[71654]:   <os>
Apr 11 20:39:14 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:39:14 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:39:14 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:39:14 user nova-compute[71654]:   </os>
Apr 11 20:39:14 user nova-compute[71654]:   <features>
Apr 11 20:39:14 user nova-compute[71654]:     <acpi/>
Apr 11 20:39:14 user nova-compute[71654]:     <apic/>
Apr 11 20:39:14 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:39:14 user nova-compute[71654]:   </features>
Apr 11 20:39:14 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:39:14 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:39:14 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:39:14 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:39:14 user nova-compute[71654]:   </clock>
Apr 11 20:39:14 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:39:14 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:39:14 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:39:14 user nova-compute[71654]:   </cpu>
Apr 11 20:39:14 user nova-compute[71654]:   <devices>
Apr 11 20:39:14 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:39:14 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:39:14 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk"/>
Apr 11 20:39:14 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:39:14 user nova-compute[71654]:     </disk>
Apr 11 20:39:14 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:39:14 user nova-compute[71654]:       <mac address="fa:16:3e:5f:2d:da"/>
Apr 11 20:39:14 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:14 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:39:14 user nova-compute[71654]:       <target dev="tapcff9d1b4-18"/>
Apr 11 20:39:14 user nova-compute[71654]:     </interface>
Apr 11 20:39:14 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:39:14 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/console.log" append="off"/>
Apr 11 20:39:14 user nova-compute[71654]:     </serial>
Apr 11 20:39:14 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:39:14 user nova-compute[71654]:     <video>
Apr 11 20:39:14 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:14 user nova-compute[71654]:     </video>
Apr 11 20:39:14 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:39:14 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:39:14 user nova-compute[71654]:     </rng>
Apr 11 20:39:14 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:39:14 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:39:14 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:39:14 user nova-compute[71654]:     </memballoon>
Apr 11 20:39:14 user nova-compute[71654]:   </devices>
Apr 11 20:39:14 user nova-compute[71654]: </domain>
Apr 11 20:39:14 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1961006747',display_name='tempest-TestMinimumBasicScenario-server-1961006747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1961006747',id=11,image_ref='34247816-448f-4660-9d3b-31800b7e69d9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ==',key_name='tempest-TestMinimumBasicScenario-338876043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-7jdekc70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34247816-448f-4660-9d3b-31800b7e69d9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:12Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=6af82381-69fc-47e5-a16f-cea88c569240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG os_vif [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcff9d1b4-18, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcff9d1b4-18, col_values=(('external_ids', {'iface-id': 'cff9d1b4-18f3-4450-8d38-f230812fb66e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:2d:da', 'vm-uuid': '6af82381-69fc-47e5-a16f-cea88c569240'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:14 user nova-compute[71654]: INFO os_vif [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18')
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No VIF found with MAC fa:16:3e:5f:2d:da, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updated VIF entry in instance network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0dbbb29e-287a-406f-9b5e-2e61f44dce88 req-8d83ecd2-54f0-4338-afdd-1cf0f5fcec2a service nova] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245557.93291, 6af82381-69fc-47e5-a16f-cea88c569240 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] VM Resumed (Lifecycle Event)
Apr 11 20:39:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:18 user nova-compute[71654]: WARNING nova.compute.manager [req-acccf681-6e87-4f9e-bc12-1676e2c5f5d8 req-98807bcd-d9b8-4d52-a9eb-2a3439c803de service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state building and task_state spawning.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:18 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:18 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:18 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=26.644733428955078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance spawned successfully.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1854ea-2102-40f5-8579-639d2974da80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245557.9354904, 6af82381-69fc-47e5-a16f-cea88c569240 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] VM Started (Lifecycle Event)
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:39:18 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea4e15-7c62-4f4a-9e85-9857196f4fea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c] added
Apr 11 20:39:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbcc281-d568-4465-900a-833431451541]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b899279f-5577-41ce-a22b-58db36f60007]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nusiAVMN {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nusiAVMN" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44ee58b-ee8f-41f2-815f-0330803e3420]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nusiAVMN'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 6af82381-69fc-47e5-a16f-cea88c569240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Took 6.33 seconds to spawn the instance on the hypervisor.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[208fd8b1-8672-495c-901f-f82f6e92ca4e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:18 user nova-compute[71654]: WARNING nova.compute.manager [req-8d4a8031-5fbb-49bc-a483-80c5d808906d req-e23210cc-ace6-489b-ab35-8ac21e238526 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state building and task_state spawning.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bce511-848e-4557-bce7-329b7b20e6c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 20:39:18 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 20:39:18 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 20:39:18 user nova-compute[71654]: 
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b86605c-1261-4322-8784-baa139cdcef7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]
Apr 11 20:39:18 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.
Apr 11 20:39:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad0b58-be6d-4480-8962-fc0c4c296a03]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Took 7.07 seconds to build instance.
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f449de18-96ff-4181-beb2-8e7736c96c97]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-09c322e1-ee84-4636-a912-231663bf6443 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.210s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c2fd7-bf64-48e1-a579-04169d1f4548]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245543.7521317, cafd98ea-fe9e-4159-a454-6833bdcb8934 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] VM Stopped (Lifecycle Event)
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dcaf1cd3-10fc-4585-bf59-6eaf4d53c563 None None] [instance: cafd98ea-fe9e-4159-a454-6833bdcb8934] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.154s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'pci_requests' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'numa_topology' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:18 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:39:18 user nova-compute[71654]: INFO nova.compute.claims [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Claim successful on node user
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:19 user nova-compute[71654]: INFO nova.network.neutron [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating port d2d4c99b-9fd2-4090-9c8a-072b6625a081 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26564363431383130', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564363431383130', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'flavor' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:39:19 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:39:19 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:39:19 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:39:19 user nova-compute[71654]:   <serial>9482e06e-2cf5-4af8-b281-e43941df6b7c</serial>
Apr 11 20:39:19 user nova-compute[71654]: </disk>
Apr 11 20:39:19 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:19 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:76:b1:a7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.objects.instance [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'flavor' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-509143b9-f8ec-4142-86f1-b590c0796e44 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.348s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:20 user nova-compute[71654]: INFO nova.compute.manager [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Attaching volume 7b9f6713-befd-4589-bd9a-3defae1c71e7 to /dev/vdb
Apr 11 20:39:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46d8828-0b94-42cd-bb56-72ff9f1afcf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc71e1a-c8d9-4434-b3fe-2dd64eaca7ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad8a9c4-7a01-405c-95e8-5a6941dd0ac6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ed8b4-b92f-4553-8063-6794c222fa8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:20 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:39:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86772a-b65a-4231-80a2-b726a638195a]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:20 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating existing volume attachment record: 27cb0d85-dd78-4f6c-b26c-4dcaf6c7fe79 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing instance network info cache due to event network-changed-d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Acquiring lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:21 user nova-compute[71654]: INFO nova.compute.manager [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Rebuilding instance
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'trusted_certs' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_requests' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_devices' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'migration_context' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71654) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:22 user nova-compute[71654]: WARNING nova.compute.manager [req-4bdbe43e-951f-4fd7-9af9-2012f95ad84d req-095dfd6d-f80e-4058-a17b-bde5ee07f9f0 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state rebuilding.
Apr 11 20:39:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance destroyed successfully.
Apr 11 20:39:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:39:23 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Creating image(s)
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:23 user nova-compute[71654]: INFO nova.compute.manager [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Detaching volume 9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Acquired lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Refreshing network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "468329d3dcd7d5dc7b716a475461bf8fe8c7064d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "468329d3dcd7d5dc7b716a475461bf8fe8c7064d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:23 user nova-compute[71654]: INFO nova.virt.block_device [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attempting to driver detach volume 9482e06e-2cf5-4af8-b281-e43941df6b7c from mountpoint /dev/vdb
Apr 11 20:39:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Attempting to detach device vdb from instance dadac585-3a7c-40d8-a335-fc2603588c28 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:39:23 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:39:23 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:39:23 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:39:23 user nova-compute[71654]:   <serial>9482e06e-2cf5-4af8-b281-e43941df6b7c</serial>
Apr 11 20:39:23 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:39:23 user nova-compute[71654]: </disk>
Apr 11 20:39:23 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:23 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully detached device vdb from instance dadac585-3a7c-40d8-a335-fc2603588c28 from the persistent domain config.
Apr 11 20:39:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:23 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 20:39:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee2754e-f9c1-4385-82dd-b6e43e51e2a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:39:24 user nova-compute[71654]: No targets found.
Apr 11 20:39:24 user nova-compute[71654]: iSNS:
Apr 11 20:39:24 user nova-compute[71654]: No targets found.
Apr 11 20:39:24 user nova-compute[71654]: STATIC:
Apr 11 20:39:24 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:39:24 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:39:24 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:39:24 user nova-compute[71654]: FIRMWARE:
Apr 11 20:39:24 user nova-compute[71654]: No targets found.
Apr 11 20:39:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:39:24 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:39:24 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6205a1-bb70-485e-a81c-944c3d8a5e47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.virt.images [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] 49564bf4-2bb0-43e5-a4d1-13c22447ab58 was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.part /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[74534b9d-34d3-4518-89da-43b9bcf245fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e697e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.086s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6145c596-51b9-47df-bb1d-5a00a18a78ee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:24 user nova-compute[71654]: WARNING nova.compute.manager [req-f669ea98-a2e4-427d-82b3-357f9605e8f9 req-b1acd4db-ee2a-45e6-994f-f9691dd8e546 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state rebuilding.
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd243070-5d67-4af2-9082-c5f2310f02dc]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b455d2-e150-4e17-8a86-369a55a5edcb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.137s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a5ef21-d918-42e0-b4bb-140c4b9fc3b4]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e079bfe5-4b75-4797-b6e2-d8a4a7ca5455]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.part /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.converted" returned: 0 in 0.559s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ebc523-c71f-4ce4-b97d-5464c5090959]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]
Apr 11 20:39:24 user nova-compute[71654]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.
Apr 11 20:39:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updated VIF entry in instance network info cache for port d2d4c99b-9fd2-4090-9c8a-072b6625a081. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25411f66-df34-49b0-b1b3-6278a929ef09 req-ec1a7ecc-3746-40d7-a946-79a158b3db0f service nova] Releasing lock "refresh_cache-534b82fe-0c07-46dd-bb21-66ad7f6b1397" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[32684e90-31ef-4be4-8588-204bbdeb2e07]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.727s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (730ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "468329d3dcd7d5dc7b716a475461bf8fe8c7064d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.768s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d --force-share --output=json" returned: 0 in 0.177s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "468329d3dcd7d5dc7b716a475461bf8fe8c7064d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "468329d3dcd7d5dc7b716a475461bf8fe8c7064d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d --force-share --output=json" returned: 0 in 0.172s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d,backing_fmt=raw /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d,backing_fmt=raw /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk 1073741824" returned: 0 in 0.059s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "468329d3dcd7d5dc7b716a475461bf8fe8c7064d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'migration_context' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Rebasing disk image.
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.155s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d -F raw /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance destroyed successfully.
Apr 11 20:39:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21864ca9-0a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:39:25 user nova-compute[71654]: INFO os_vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:39:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:25 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a85310d1-82ae-42df-90fe-84738fbbf6c7]: Unexpected error while running command.
Apr 11 20:39:25 user nova-compute[71654]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 20:39:25 user nova-compute[71654]: Exit code: 21
Apr 11 20:39:25 user nova-compute[71654]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 20:39:25 user nova-compute[71654]: Stderr: '' {{(pid=81862) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 11 20:39:25 user nova-compute[71654]: Traceback (most recent call last):
Apr 11 20:39:25 user nova-compute[71654]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 11 20:39:25 user nova-compute[71654]:     ret = func(*f_args, **f_kwargs)
Apr 11 20:39:25 user nova-compute[71654]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 11 20:39:25 user nova-compute[71654]:     return func(*args, **kwargs)
Apr 11 20:39:25 user nova-compute[71654]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 11 20:39:25 user nova-compute[71654]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 11 20:39:25 user nova-compute[71654]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 11 20:39:25 user nova-compute[71654]:     return putils.execute(on_execute=on_execute,
Apr 11 20:39:25 user nova-compute[71654]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 11 20:39:25 user nova-compute[71654]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 11 20:39:25 user nova-compute[71654]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 20:39:25 user nova-compute[71654]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 20:39:25 user nova-compute[71654]: Exit code: 21
Apr 11 20:39:25 user nova-compute[71654]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 20:39:25 user nova-compute[71654]: Stderr: ''
Apr 11 20:39:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85310d1-82ae-42df-90fe-84738fbbf6c7]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 20:39:25 user nova-compute[71654]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 20:39:25 user nova-compute[71654]: Exit code: 21
Apr 11 20:39:25 user nova-compute[71654]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 20:39:25 user nova-compute[71654]: Stderr: ''
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4084, in _do_rebuild_instance
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi 
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi 
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 11 20:39:25 user nova-compute[71654]: ERROR os_brick.initiator.connectors.iscsi 
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71654) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (52ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:39:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Deleting instance files /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_del
Apr 11 20:39:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Deletion of /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_del complete
Apr 11 20:39:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlbTwYaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:26 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:26 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:26 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:39:26 user nova-compute[71654]: INFO nova.virt.block_device [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Booting with volume 9482e06e-2cf5-4af8-b281-e43941df6b7c at /dev/vdb
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7096ce58-d1d0-4145-a3fb-5bcc651274fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:39:26 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbdde6b-7b63-4d65-a082-b086ee43dfa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7] added
Apr 11 20:39:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.utils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6629a1e-f432-473b-9062-9c77eba9b6e9]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ac8f0-9939-49ef-8517-79bcacf9e022]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7feb09b-4f46-4b6f-b58a-0363847d277e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlbTwYaZ {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c3fe8-9d97-49b1-9347-be23afe88257]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlbTwYaZ" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e2de8-fe8a-4daa-bfb9-ee9759141878]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GlbTwYaZ'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b1dd5-c05d-479d-a54e-772fcdad4707]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b198c-b240-4c4a-9243-63f630480df6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648acd1-875a-4ebc-b63c-eacf4874b6ac]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:26 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c329c-1385-4417-bb84-d703a69ea285]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.utils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating existing volume attachment record: ded20ada-1da7-44ed-a45a-0aca3a7a8133 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5d09de-8a20-4002-b5d3-55f20aee542a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 20:39:26 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 20:39:26 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:26 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 20:39:26 user nova-compute[71654]: 
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[36643442-c878-42f3-bb8b-3fc56c701d48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260]
Apr 11 20:39:26 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260] successful.
Apr 11 20:39:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0adaa85-c935-4009-9383-95d14b8ed1c6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9503cf39-2808-4d1b-957b-c6bb96dff26e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c262b-04b4-4766-b0ad-f8ff3f0600d3]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlbTwYaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:39:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23336356561386133', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336356561386133', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'flavor' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:39:27 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:39:27 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:39:27 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:39:27 user nova-compute[71654]:   <serial>7b9f6713-befd-4589-bd9a-3defae1c71e7</serial>
Apr 11 20:39:27 user nova-compute[71654]: </disk>
Apr 11 20:39:27 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d -F raw /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk" returned: 0 in 2.256s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Ensure instance console log exists: /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Start _get_guest_xml network_info=[{"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='2a2d521382a1c66326ca6c3852554b09',container_format='bare',created_at=2023-04-11T20:37:21Z,direct_url=<?>,disk_format='qcow2',id=49564bf4-2bb0-43e5-a4d1-13c22447ab58,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1482156858-shelved',owner='0d5fce55f8224068805593f94d5f2d36',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T20:37:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnfsugtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '534b82fe-0c07-46dd-bb21-66ad7f6b1397', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac687e43-f85e-48a9-bbbe-69afaba2ec38', 'serial': 'ac687e43-f85e-48a9-bbbe-69afaba2ec38'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '92bab3ae-30b5-4562-aec3-111e04f18696', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:39:27 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:27 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2a2d521382a1c66326ca6c3852554b09',container_format='bare',created_at=2023-04-11T20:37:21Z,direct_url=<?>,disk_format='qcow2',id=49564bf4-2bb0-43e5-a4d1-13c22447ab58,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1482156858-shelved',owner='0d5fce55f8224068805593f94d5f2d36',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T20:37:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:39:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnfsugtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:28 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:28 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:28 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0535e6-b9c5-429d-830b-6191c64d8a53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:39:28 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d85c2-6813-4456-a80d-96ab2dcc1a0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38] added
Apr 11 20:39:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No VIF found with MAC fa:16:3e:7c:29:9c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91bf480-e937-4da2-a329-2ab98a6e81fd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a566a7-b527-4a82-bd81-dd3bc25840ce]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnfsugtF {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnfsugtF" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e29c7-8bb9-4f5c-a4d7-9fd653a96ab4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnfsugtF'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d908f7-095d-4cfd-ad94-9bd67000d7a0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bff6be-8b73-45ae-a908-d7c37f24adba]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20aaf8c2-a0c7-4c09-ae61-cad016d88588 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.592s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90c876c-2d73-434e-8e71-6dc8f86f7ea0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260]
Apr 11 20:39:28 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260] successful.
Apr 11 20:39:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[567afc3a-e846-4a1a-bdd2-05b0f058be8f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff7b9eb-251a-4fe7-9688-234a2e65decd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:28 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:28 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1184075-e6e7-42c2-baf8-013471215be8]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnfsugtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:39:28 user nova-compute[71654]: INFO nova.compute.manager [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Rescuing
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:39:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26137666635623663', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137666635623663', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482156858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482156858',id=2,image_ref='49564bf4-2bb0-43e5-a4d1-13c22447ab58',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1950690295',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-y79rwl52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member',shelved_at='2023-04-11T20:37:25.288488',shelved_host='user',shelved_image_id='49564bf4-2bb0-43e5-a4d1-13c22447ab58'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=534b82fe-0c07-46dd-bb21-66ad7f6b1397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'pci_devices' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:39:29 user nova-compute[71654]:   <uuid>534b82fe-0c07-46dd-bb21-66ad7f6b1397</uuid>
Apr 11 20:39:29 user nova-compute[71654]:   <name>instance-00000002</name>
Apr 11 20:39:29 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:39:29 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:39:29 user nova-compute[71654]:   <metadata>
Apr 11 20:39:29 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:39:29 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:39:29 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1482156858</nova:name>
Apr 11 20:39:29 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:39:27</nova:creationTime>
Apr 11 20:39:29 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:39:29 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:39:29 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:39:29 user nova-compute[71654]:       <nova:owner>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:user uuid="f82468d207064eb288a2c8a167cd7d9d">tempest-AttachVolumeShelveTestJSON-426216861-project-member</nova:user>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:project uuid="0d5fce55f8224068805593f94d5f2d36">tempest-AttachVolumeShelveTestJSON-426216861</nova:project>
Apr 11 20:39:29 user nova-compute[71654]:       </nova:owner>
Apr 11 20:39:29 user nova-compute[71654]:       <nova:root type="image" uuid="49564bf4-2bb0-43e5-a4d1-13c22447ab58"/>
Apr 11 20:39:29 user nova-compute[71654]:       <nova:ports>
Apr 11 20:39:29 user nova-compute[71654]:         <nova:port uuid="d2d4c99b-9fd2-4090-9c8a-072b6625a081">
Apr 11 20:39:29 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:39:29 user nova-compute[71654]:         </nova:port>
Apr 11 20:39:29 user nova-compute[71654]:       </nova:ports>
Apr 11 20:39:29 user nova-compute[71654]:     </nova:instance>
Apr 11 20:39:29 user nova-compute[71654]:   </metadata>
Apr 11 20:39:29 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:39:29 user nova-compute[71654]:     <system>
Apr 11 20:39:29 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:39:29 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:39:29 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:39:29 user nova-compute[71654]:       <entry name="serial">534b82fe-0c07-46dd-bb21-66ad7f6b1397</entry>
Apr 11 20:39:29 user nova-compute[71654]:       <entry name="uuid">534b82fe-0c07-46dd-bb21-66ad7f6b1397</entry>
Apr 11 20:39:29 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:39:29 user nova-compute[71654]:     </system>
Apr 11 20:39:29 user nova-compute[71654]:   </sysinfo>
Apr 11 20:39:29 user nova-compute[71654]:   <os>
Apr 11 20:39:29 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:39:29 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:39:29 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:39:29 user nova-compute[71654]:   </os>
Apr 11 20:39:29 user nova-compute[71654]:   <features>
Apr 11 20:39:29 user nova-compute[71654]:     <acpi/>
Apr 11 20:39:29 user nova-compute[71654]:     <apic/>
Apr 11 20:39:29 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:39:29 user nova-compute[71654]:   </features>
Apr 11 20:39:29 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:39:29 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:39:29 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:39:29 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:39:29 user nova-compute[71654]:   </clock>
Apr 11 20:39:29 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:39:29 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:39:29 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:39:29 user nova-compute[71654]:   </cpu>
Apr 11 20:39:29 user nova-compute[71654]:   <devices>
Apr 11 20:39:29 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:39:29 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:39:29 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk"/>
Apr 11 20:39:29 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:39:29 user nova-compute[71654]:     </disk>
Apr 11 20:39:29 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:39:29 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:39:29 user nova-compute[71654]:       <source dev="/dev/sdc"/>
Apr 11 20:39:29 user nova-compute[71654]:       <target dev="vdc" bus="virtio"/>
Apr 11 20:39:29 user nova-compute[71654]:       <serial>ac687e43-f85e-48a9-bbbe-69afaba2ec38</serial>
Apr 11 20:39:29 user nova-compute[71654]:     </disk>
Apr 11 20:39:29 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:39:29 user nova-compute[71654]:       <mac address="fa:16:3e:d1:0b:a8"/>
Apr 11 20:39:29 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:29 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:39:29 user nova-compute[71654]:       <target dev="tapd2d4c99b-9f"/>
Apr 11 20:39:29 user nova-compute[71654]:     </interface>
Apr 11 20:39:29 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:39:29 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/console.log" append="off"/>
Apr 11 20:39:29 user nova-compute[71654]:     </serial>
Apr 11 20:39:29 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:39:29 user nova-compute[71654]:     <video>
Apr 11 20:39:29 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:29 user nova-compute[71654]:     </video>
Apr 11 20:39:29 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:39:29 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:39:29 user nova-compute[71654]:     </rng>
Apr 11 20:39:29 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:39:29 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:39:29 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:39:29 user nova-compute[71654]:     </memballoon>
Apr 11 20:39:29 user nova-compute[71654]:   </devices>
Apr 11 20:39:29 user nova-compute[71654]: </domain>
Apr 11 20:39:29 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482156858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482156858',id=2,image_ref='49564bf4-2bb0-43e5-a4d1-13c22447ab58',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1950690295',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-y79rwl52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member',shelved_at='2023-04-11T20:37:25.288488',shelved_host='user',shelved_image_id='49564bf4-2bb0-43e5-a4d1-13c22447ab58'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=534b82fe-0c07-46dd-bb21-66ad7f6b1397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG os_vif [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2d4c99b-9f, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2d4c99b-9f, col_values=(('external_ids', {'iface-id': 'd2d4c99b-9fd2-4090-9c8a-072b6625a081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0b:a8', 'vm-uuid': '534b82fe-0c07-46dd-bb21-66ad7f6b1397'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:29 user nova-compute[71654]: INFO os_vif [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f')
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No VIF found with MAC fa:16:3e:d1:0b:a8, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:30 user nova-compute[71654]: WARNING nova.compute.manager [req-d126f83b-a275-4fbf-b616-019413dab9f9 req-00832279-352c-42b1-85d4-37a2916c4576 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state active and task_state rescuing.
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:39:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Creating image(s)
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance destroyed successfully.
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.166s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Attempting a stable device rescue
Apr 11 20:39:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71654) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:39:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Creating image(s)
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'trusted_certs' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "b73ea97149d66578f17a7ef77f3108c5cf92daca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "b73ea97149d66578f17a7ef77f3108c5cf92daca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk 1073741824" returned: 0 in 0.049s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:32 user nova-compute[71654]: WARNING nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state active and task_state rescuing.
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:32 user nova-compute[71654]: WARNING nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:32 user nova-compute[71654]: WARNING nova.compute.manager [req-cd1b3d14-db66-428a-8963-80543d79219f req-3226f798-cc38-4564-9c71-6893cc8ead0e service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.980s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.part --force-share --output=json" returned: 0 in 0.173s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.images [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] 1906d4ae-83e8-471b-b5db-3d5abb7016eb was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.part /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Cannot resize image /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Ensure instance console log exists: /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start _get_guest_xml network_info=[{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dadac585-3a7c-40d8-a335-fc2603588c28', 'attached_at': '', 'detached_at': '', 'volume_id': '9482e06e-2cf5-4af8-b281-e43941df6b7c', 'serial': '9482e06e-2cf5-4af8-b281-e43941df6b7c'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ded20ada-1da7-44ed-a45a-0aca3a7a8133', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:39:32 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 20:39:32 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:39:32 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'vcpu_model' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:33 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:33 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:33 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260" returned: 21 in 0.110s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f573231-b13e-4e00-a71d-1b267d5b9bac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:39:33 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.part /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.converted" returned: 0 in 0.349s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f9598-1d45-476f-aea1-6227bf216f2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c] added
Apr 11 20:39:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a38f35-069d-42ad-a15b-b147d31d0c67]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab1b8ee-9c9a-4a3c-8376-96dc410e9121]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nusiAVMN {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nusiAVMN" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c69b263-6b98-465d-9a1e-f7bdc02dec13]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nusiAVMN'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "b73ea97149d66578f17a7ef77f3108c5cf92daca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.611s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "b73ea97149d66578f17a7ef77f3108c5cf92daca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "b73ea97149d66578f17a7ef77f3108c5cf92daca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[550f765e-ca8f-413e-a253-c61fccb1fb7a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[030fe14b-27ed-439e-a47e-973fd4a4cd38]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[64263576-e16a-4649-8b7c-03dc316fccdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]
Apr 11 20:39:33 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.
Apr 11 20:39:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca,backing_fmt=raw /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cda6e1-dd9b-42f1-b9a6-b9a8be656541]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca,backing_fmt=raw /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue" returned: 0 in 0.057s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "b73ea97149d66578f17a7ef77f3108c5cf92daca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'migration_context' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeb4afb-9663-4231-8017-2cb8fcaf5964]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:33 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.497s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Start _get_guest_xml network_info=[{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "vif_mac": "fa:16:3e:7c:29:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1906d4ae-83e8-471b-b5db-3d5abb7016eb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlbTwYaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fe5fb157-6ca9-4e9f-87c6-11300909fdca', 'attached_at': '', 'detached_at': '', 'volume_id': '7b9f6713-befd-4589-bd9a-3defae1c71e7', 'serial': '7b9f6713-befd-4589-bd9a-3defae1c71e7'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '27cb0d85-dd78-4f6c-b26c-4dcaf6c7fe79', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'resources' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc60fd-6461-42a5-a582-5e7b84424c13]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'numa_topology' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:33 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:33 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'vcpu_model' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlbTwYaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:33 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245573.6542177, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] VM Resumed (Lifecycle Event)
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:39:33 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance spawned successfully.
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245573.6603947, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] VM Started (Lifecycle Event)
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:39:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8f1daee-8fe9-4f34-a52f-5048c9198d30 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.348s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.532s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1533ms) {'type': 'block', 'scsi_wwn': '26564363431383130', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564363431383130', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.911s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:34 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:39:34 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c82b0c-f6d8-44fc-8975-d650d0a30091]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GlbTwYaZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 20:39:34 user nova-compute[71654]: node.name = iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:39:34 user nova-compute[71654]: node.tpgt = -1
Apr 11 20:39:34 user nova-compute[71654]: node.startup = automatic
Apr 11 20:39:34 user nova-compute[71654]: node.leading_login = No
Apr 11 20:39:34 user nova-compute[71654]: iface.iscsi_ifacename = default
Apr 11 20:39:34 user nova-compute[71654]: iface.net_ifacename = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.ipaddress = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.prefix_len = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.hwaddress = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.transport_name = tcp
Apr 11 20:39:34 user nova-compute[71654]: iface.initiatorname = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.vlan_id = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.vlan_priority = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.vlan_state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.iface_num = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.mtu = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.port = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.bootproto = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.subnet_mask = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.gateway = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_alt_client_id = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_dns = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_learn_iqn = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_vendor_id_state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_vendor_id = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.dhcp_slp_da = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.fragmentation = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.gratuitous_arp = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.incoming_forwarding = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.tos_state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.tos = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.ttl = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.delayed_ack = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.tcp_nagle = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.tcp_wsf_state = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.tcp_wsf = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.tcp_timer_scale = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.tcp_timestamp = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.redirect = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.def_task_mgmt_timeout = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.header_digest = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.data_digest = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.immediate_data = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.initial_r2t = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.data_seq_inorder = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.data_pdu_inorder = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.erl = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.max_receive_data_len = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.first_burst_len = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.max_outstanding_r2t = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.max_burst_len = 0
Apr 11 20:39:34 user nova-compute[71654]: iface.chap_auth = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.bidi_chap = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.strict_login_compliance = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.discovery_auth = <empty>
Apr 11 20:39:34 user nova-compute[71654]: iface.discovery_logout = <empty>
Apr 11 20:39:34 user nova-compute[71654]: node.discovery_address = <empty>
Apr 11 20:39:34 user nova-compute[71654]: node.discovery_port = 0
Apr 11 20:39:34 user nova-compute[71654]: node.discovery_type = static
Apr 11 20:39:34 user nova-compute[71654]: node.session.initial_cmdsn = 0
Apr 11 20:39:34 user nova-compute[71654]: node.session.initial_login_retry_max = 8
Apr 11 20:39:34 user nova-compute[71654]: node.session.xmit_thread_priority = -20
Apr 11 20:39:34 user nova-compute[71654]: node.session.cmds_max = 128
Apr 11 20:39:34 user nova-compute[71654]: node.session.queue_depth = 32
Apr 11 20:39:34 user nova-compute[71654]: node.session.nr_sessions = 1
Apr 11 20:39:34 user nova-compute[71654]: node.session.auth.authmethod = CHAP
Apr 11 20:39:34 user nova-compute[71654]: node.session.auth.username = GlbTwYaZ
Apr 11 20:39:34 user nova-compute[71654]: node.session.auth.password = ***
Apr 11 20:39:34 user nova-compute[71654]: node.session.auth.username_in = <empty>
Apr 11 20:39:34 user nova-compute[71654]: node.session.auth.password_in = <empty>
Apr 11 20:39:34 user nova-compute[71654]: node.session.auth.chap_algs = MD5
Apr 11 20:39:34 user nova-compute[71654]: node.session.timeo.replacement_timeout = 120
Apr 11 20:39:34 user nova-compute[71654]: node.session.err_timeo.abort_timeout = 15
Apr 11 20:39:34 user nova-compute[71654]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 20:39:34 user nova-compute[71654]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 20:39:34 user nova-compute[71654]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.FastAbort = Yes
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.InitialR2T = No
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.ImmediateData = Yes
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.MaxConnections = 1
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 20:39:34 user nova-compute[71654]: node.session.iscsi.ERL = 0
Apr 11 20:39:34 user nova-compute[71654]: node.session.scan = manual
Apr 11 20:39:34 user nova-compute[71654]: node.session.reopen_max = 0
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].address = 172.16.0.220
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].port = 3260
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].startup = manual
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].tcp.window_size = 524288
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].tcp.type_of_service = 0
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].timeo.logout_timeout = 15
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].timeo.login_timeout = 15
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].timeo.auth_timeout = 45
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].iscsi.DataDigest = None
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].iscsi.IFMarker = No
Apr 11 20:39:34 user nova-compute[71654]: node.conn[0].iscsi.OFMarker = No
Apr 11 20:39:34 user nova-compute[71654]: # END RECORD
Apr 11 20:39:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:39:34 user nova-compute[71654]:   <uuid>dadac585-3a7c-40d8-a335-fc2603588c28</uuid>
Apr 11 20:39:34 user nova-compute[71654]:   <name>instance-00000003</name>
Apr 11 20:39:34 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:39:34 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:39:34 user nova-compute[71654]:   <metadata>
Apr 11 20:39:34 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:39:34 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-1788631209</nova:name>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:39:32</nova:creationTime>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:39:34 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:39:34 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:owner>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:39:34 user nova-compute[71654]:       </nova:owner>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:ports>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:port uuid="21864ca9-0ae0-4591-a5bc-fac2428743cb">
Apr 11 20:39:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:39:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:39:34 user nova-compute[71654]:       </nova:ports>
Apr 11 20:39:34 user nova-compute[71654]:     </nova:instance>
Apr 11 20:39:34 user nova-compute[71654]:   </metadata>
Apr 11 20:39:34 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:39:34 user nova-compute[71654]:     <system>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="serial">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="uuid">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:39:34 user nova-compute[71654]:     </system>
Apr 11 20:39:34 user nova-compute[71654]:   </sysinfo>
Apr 11 20:39:34 user nova-compute[71654]:   <os>
Apr 11 20:39:34 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:39:34 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:39:34 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:39:34 user nova-compute[71654]:   </os>
Apr 11 20:39:34 user nova-compute[71654]:   <features>
Apr 11 20:39:34 user nova-compute[71654]:     <acpi/>
Apr 11 20:39:34 user nova-compute[71654]:     <apic/>
Apr 11 20:39:34 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:39:34 user nova-compute[71654]:   </features>
Apr 11 20:39:34 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:39:34 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:39:34 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:39:34 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:39:34 user nova-compute[71654]:   </clock>
Apr 11 20:39:34 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:39:34 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:39:34 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:39:34 user nova-compute[71654]:   </cpu>
Apr 11 20:39:34 user nova-compute[71654]:   <devices>
Apr 11 20:39:34 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:39:34 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:39:34 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:     </disk>
Apr 11 20:39:34 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:39:34 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:39:34 user nova-compute[71654]:       <source dev="/dev/sdd"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:       <serial>9482e06e-2cf5-4af8-b281-e43941df6b7c</serial>
Apr 11 20:39:34 user nova-compute[71654]:     </disk>
Apr 11 20:39:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:39:34 user nova-compute[71654]:       <mac address="fa:16:3e:76:b1:a7"/>
Apr 11 20:39:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="tap21864ca9-0a"/>
Apr 11 20:39:34 user nova-compute[71654]:     </interface>
Apr 11 20:39:34 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:39:34 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log" append="off"/>
Apr 11 20:39:34 user nova-compute[71654]:     </serial>
Apr 11 20:39:34 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:39:34 user nova-compute[71654]:     <video>
Apr 11 20:39:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:     </video>
Apr 11 20:39:34 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:39:34 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:39:34 user nova-compute[71654]:     </rng>
Apr 11 20:39:34 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:39:34 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:39:34 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:39:34 user nova-compute[71654]:     </memballoon>
Apr 11 20:39:34 user nova-compute[71654]:   </devices>
Apr 11 20:39:34 user nova-compute[71654]: </domain>
Apr 11 20:39:34 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21864ca9-0a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21864ca9-0a, col_values=(('external_ids', {'iface-id': '21864ca9-0ae0-4591-a5bc-fac2428743cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b1:a7', 'vm-uuid': 'dadac585-3a7c-40d8-a335-fc2603588c28'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[084d0ca8-8638-404d-8c66-f57286205f73]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:34 user nova-compute[71654]: INFO os_vif [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee11aea-a579-404d-8fda-fd3dd0ecfa6c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlbTwYaZ {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GlbTwYaZ" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed89b8f7-36b8-4770-8495-fdcf3bb6f820]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GlbTwYaZ'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46ab0a-9dae-457d-a441-725e0db2d2dc]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:76:b1:a7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce03204e-4ff1-4ea6-bd57-6430b7c84a8d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:34 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:34 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:39:34 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:39:34 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:39:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94624ff-0ec3-4628-af43-cd2fa7de01b9]: (4, ('0 0 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlbTwYaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] <== connect_volume: return (1125ms) {'type': 'block', 'scsi_wwn': '23336356561386133', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336356561386133', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743051561',display_name='tempest-ServerStableDeviceRescueTest-server-1743051561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743051561',id=4,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8edukNlRzRt2xM1Yz79RSQhOkxsm8ccsONALiSEdR71l6YiK0hGivRdMEIPe6FhH/dBsOBuEPFT6mch0ytfQkkG8lca42/DiYBmO2hVEc7hq5brWI1oZCdGBeI4245iw==',key_name='tempest-keypair-2032053389',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8329ebeb037462d864dd5cf8aefc6b8',ramdisk_id='',reservation_id='r-nn7gj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-435801344',owner_user_name='tempest-ServerStableDeviceRescueTest-435801344-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127b201d67de4bacaed034d4becdc955',uuid=fe5fb157-6ca9-4e9f-87c6-11300909fdca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "vif_mac": "fa:16:3e:7c:29:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converting VIF {"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "vif_mac": "fa:16:3e:7c:29:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'pci_devices' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:39:34 user nova-compute[71654]:   <uuid>fe5fb157-6ca9-4e9f-87c6-11300909fdca</uuid>
Apr 11 20:39:34 user nova-compute[71654]:   <name>instance-00000004</name>
Apr 11 20:39:34 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:39:34 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:39:34 user nova-compute[71654]:   <metadata>
Apr 11 20:39:34 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:39:34 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1743051561</nova:name>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:39:33</nova:creationTime>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:39:34 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:39:34 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:owner>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:user uuid="127b201d67de4bacaed034d4becdc955">tempest-ServerStableDeviceRescueTest-435801344-project-member</nova:user>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:project uuid="e8329ebeb037462d864dd5cf8aefc6b8">tempest-ServerStableDeviceRescueTest-435801344</nova:project>
Apr 11 20:39:34 user nova-compute[71654]:       </nova:owner>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:39:34 user nova-compute[71654]:       <nova:ports>
Apr 11 20:39:34 user nova-compute[71654]:         <nova:port uuid="1ef9bc31-64d9-48ac-b54c-80d0b4487897">
Apr 11 20:39:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:39:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:39:34 user nova-compute[71654]:       </nova:ports>
Apr 11 20:39:34 user nova-compute[71654]:     </nova:instance>
Apr 11 20:39:34 user nova-compute[71654]:   </metadata>
Apr 11 20:39:34 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:39:34 user nova-compute[71654]:     <system>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="serial">fe5fb157-6ca9-4e9f-87c6-11300909fdca</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="uuid">fe5fb157-6ca9-4e9f-87c6-11300909fdca</entry>
Apr 11 20:39:34 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:39:34 user nova-compute[71654]:     </system>
Apr 11 20:39:34 user nova-compute[71654]:   </sysinfo>
Apr 11 20:39:34 user nova-compute[71654]:   <os>
Apr 11 20:39:34 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:39:34 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:39:34 user nova-compute[71654]:   </os>
Apr 11 20:39:34 user nova-compute[71654]:   <features>
Apr 11 20:39:34 user nova-compute[71654]:     <acpi/>
Apr 11 20:39:34 user nova-compute[71654]:     <apic/>
Apr 11 20:39:34 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:39:34 user nova-compute[71654]:   </features>
Apr 11 20:39:34 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:39:34 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:39:34 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:39:34 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:39:34 user nova-compute[71654]:   </clock>
Apr 11 20:39:34 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:39:34 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:39:34 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:39:34 user nova-compute[71654]:   </cpu>
Apr 11 20:39:34 user nova-compute[71654]:   <devices>
Apr 11 20:39:34 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:39:34 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:39:34 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:     </disk>
Apr 11 20:39:34 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:39:34 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:39:34 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:       <serial>7b9f6713-befd-4589-bd9a-3defae1c71e7</serial>
Apr 11 20:39:34 user nova-compute[71654]:     </disk>
Apr 11 20:39:34 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:39:34 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:39:34 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="vdc" bus="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:       <boot order="1"/>
Apr 11 20:39:34 user nova-compute[71654]:     </disk>
Apr 11 20:39:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:39:34 user nova-compute[71654]:       <mac address="fa:16:3e:7c:29:9c"/>
Apr 11 20:39:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:39:34 user nova-compute[71654]:       <target dev="tap1ef9bc31-64"/>
Apr 11 20:39:34 user nova-compute[71654]:     </interface>
Apr 11 20:39:34 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:39:34 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/console.log" append="off"/>
Apr 11 20:39:34 user nova-compute[71654]:     </serial>
Apr 11 20:39:34 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:39:34 user nova-compute[71654]:     <video>
Apr 11 20:39:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:39:34 user nova-compute[71654]:     </video>
Apr 11 20:39:34 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:39:34 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:39:34 user nova-compute[71654]:     </rng>
Apr 11 20:39:34 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:39:34 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:39:34 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:39:34 user nova-compute[71654]:     </memballoon>
Apr 11 20:39:34 user nova-compute[71654]:   </devices>
Apr 11 20:39:34 user nova-compute[71654]: </domain>
Apr 11 20:39:34 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:39:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance destroyed successfully.
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:39:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] No VIF found with MAC fa:16:3e:7c:29:9c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:39:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:37 user nova-compute[71654]: WARNING nova.compute.manager [req-7566fd11-981f-46a2-8517-b93df8cfe4ba req-f7e7fade-941f-4fb3-a1b5-bff01dec935d service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state rebuild_spawning.
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245562.7833197, dadac585-3a7c-40d8-a335-fc2603588c28 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:37 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Stopped (Lifecycle Event)
Apr 11 20:39:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c5bd9e66-08d2-4190-a661-286d65beae37 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:37 user nova-compute[71654]: WARNING nova.compute.manager [req-c5693d23-e1b8-4d7d-8c0f-d751c0fbc54b req-cb09020a-d58e-4d4c-bfd9-9c1245a8a8e8 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state active and task_state rescuing.
Apr 11 20:39:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:39 user nova-compute[71654]: WARNING nova.compute.manager [req-9059f63f-12ab-4a89-aa53-8ae2002c99f7 req-f700427a-da58-47f6-b202-7bfbeac0f868 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state rebuild_spawning.
Apr 11 20:39:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:39:40 user nova-compute[71654]: WARNING nova.compute.manager [req-a07b5e38-b968-4de3-8402-ec24dbca08ad req-099af3bf-2369-4dcc-aba4-ee723703b35b service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state active and task_state rescuing.
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245580.2197263, dadac585-3a7c-40d8-a335-fc2603588c28 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Resumed (Lifecycle Event)
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8d03c459-7077-4a76-a6c3-a3ad06cc3877 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance spawned successfully.
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245580.2308736, dadac585-3a7c-40d8-a335-fc2603588c28 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Started (Lifecycle Event)
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for fe5fb157-6ca9-4e9f-87c6-11300909fdca due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245580.232193, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Resumed (Lifecycle Event)
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245580.232374, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:39:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Started (Lifecycle Event)
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71654) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 20:39:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5829a946-6261-4e62-acc4-cc374bffb7ae tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:39:50 user nova-compute[71654]: INFO nova.compute.claims [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Claim successful on node user
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:39:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:39:50 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:39:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG nova.policy [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928391a137c94107af4dd426b9a086f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89f013fadbe411caf0a6f2856a11135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:39:51 user nova-compute[71654]: INFO nova.virt.block_device [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Booting with volume 0b80e2a1-e119-4c40-97c9-7d393ddf700c at /dev/vda
Apr 11 20:39:51 user nova-compute[71654]: DEBUG os_brick.utils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b986162-f683-4b4e-97b1-1f8d584cec33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.048s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade2406b-0312-4d55-844f-bed3c12845fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e484a3f-341d-4526-95e0-2c954846e60b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd4dad-f5d5-4442-993a-41ea69e259d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:51 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:39:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3cb76-3a6a-4b7e-9d17-e9ed5e2cce42]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG os_brick.utils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating existing volume attachment record: 1dd9ea71-03a3-4245-b6ca-93df0ddb3572 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:39:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully created port: 893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:39:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully created port: 6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:39:54 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully created port: 1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:39:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully created port: c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully created port: 030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:56 user nova-compute[71654]: INFO nova.virt.block_device [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Booting with volume 7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d at /dev/vdb
Apr 11 20:39:56 user nova-compute[71654]: DEBUG os_brick.utils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e8e0ee-d94e-483f-b7dc-220fbdc9d35a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[280eb3ba-97d2-488d-98aa-50a19510130c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e8c5ab-60c9-4397-a5ab-161612d1d4e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dace19-fe3e-4d35-ba8e-0b0c6d0bcd6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:39:56 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:39:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[70af7cc9-aabe-4932-a258-a14b450b13e4]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG os_brick.utils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:39:56 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating existing volume attachment record: 0551dfb4-590a-462b-86e2-46128af19a88 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: 893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-893b51e3-f5e5-41fa-aa56-913f6518dd5c. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG nova.network.neutron [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port 893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG nova.network.neutron [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG nova.network.neutron [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:39:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2616de02-8019-441a-b473-bab7f4602608 req-8587b2f0-ee5e-4718-995f-5f96d1f0fcc5 service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: 4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-4af039ce-a832-46f5-9c67-e57a075dec43. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port 4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:39:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:00 user nova-compute[71654]: DEBUG nova.network.neutron [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-73d55ff6-bcd4-499a-8638-1e785823ab70 req-0e6abdd7-3c74-4198-b24c-feb87c08d715 service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: 6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-fa937413-1cdc-4426-8707-25d48f79124c. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:01 user nova-compute[71654]: INFO nova.virt.block_device [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Booting with volume 78e8c94c-6902-4769-9266-b990c406ce59 at /dev/vdc
Apr 11 20:40:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG os_brick.utils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5acb5-6bf9-4390-8d9f-fbdfd1de8c75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24ec810-1d91-440b-a505-87a77d4a01dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ece927-4afb-426b-a3ec-96c0329e40f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a1fa47-4cce-42c5-af2e-f5b8c470f96c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:40:01 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:40:01 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[132ae14d-a1fd-45f0-b8f5-de5ee5e1a96b]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG os_brick.utils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating existing volume attachment record: f08204a2-9c52-4aa3-a345-af4f6a74597f {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:40:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: 1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port 6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7163bf11-56be-464d-875c-80ded6b4a15e req-6876f9c2-ba6d-4384-8980-d4b77d20e98f service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-1380e6a6-4036-442f-8120-243f80c0e646. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port 1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-c20d2e13-a748-4cdd-9ba0-5350f331d56b. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.network.neutron [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.network.neutron [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.network.neutron [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d62c8dd5-8cb7-4e9a-affe-9b2f06f38156 req-3f732e4f-8ad2-48a2-8e21-1682a4f64fee service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Successfully updated port: 030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-030dae9d-cc5b-4278-935b-b032bf6d29dd. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:40:06 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Creating image(s)
Apr 11 20:40:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Ensure instance console log exists: /opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [{"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance network_info: |[{"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.network.neutron [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port 030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Start _get_guest_xml network_info=[{"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIjskBQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '921fec20-d5dc-4387-b265-2d16a1c226f2', 'attached_at': '', 'detached_at': '', 'volume_id': '0b80e2a1-e119-4c40-97c9-7d393ddf700c', 'serial': '0b80e2a1-e119-4c40-97c9-7d393ddf700c'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '1dd9ea71-03a3-4245-b6ca-93df0ddb3572', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxkQPVhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '921fec20-d5dc-4387-b265-2d16a1c226f2', 'attached_at': '', 'detached_at': '', 'volume_id': '7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d', 'serial': '7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '0551dfb4-590a-462b-86e2-46128af19a88', 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgUhjnXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '921fec20-d5dc-4387-b265-2d16a1c226f2', 'attached_at': '', 'detached_at': '', 'volume_id': '78e8c94c-6902-4769-9266-b990c406ce59', 'serial': '78e8c94c-6902-4769-9266-b990c406ce59'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'f08204a2-9c52-4aa3-a345-af4f6a74597f', 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:40:07 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:07 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIjskBQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:40:07 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:40:07 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:40:07 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:40:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260" returned: 21 in 0.049s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed96033-59a2-4ef7-9f6f-e92b8713905a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:40:07 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa8ea07-ca06-443b-8596-f3dfd699d162]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c] added
Apr 11 20:40:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076d530-c2a1-4bcd-8515-cd88b399c0ea]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eee7a4-a29b-43aa-b340-c59c00a321ba]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIjskBQG {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIjskBQG" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[40126526-7368-470f-8909-457e2b132c07]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZIjskBQG'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0cfd0a-2f64-4400-8251-ebaac36f1283]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fafeed-6584-4260-bfc9-11f17dbdde61]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --login" returned: 0 in 0.147s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c44b54-dfe4-4f61-8dd5-568e5afb21e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260]
Apr 11 20:40:08 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260] successful.
Apr 11 20:40:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f2b94-5617-4b22-a305-101c01f404fb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f38af6-1b2f-490b-a39d-7a64ef0b29bb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:08 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ae95e-da43-48e0-bb6d-b7c26e84b346]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG nova.network.neutron [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updated VIF entry in instance network info cache for port 030dae9d-cc5b-4278-935b-b032bf6d29dd. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG nova.network.neutron [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [{"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-756ae755-9bde-472a-8b75-a47e865313bd req-d6da254e-c541-4c57-bc2a-b9d1c5d2b527 service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIjskBQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23462666131663735', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462666131663735', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxkQPVhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:40:09 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:40:09 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:40:09 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80af790-8a5c-496a-91cb-602b84104886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:40:09 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7458a40c-945a-4ff8-9ab2-2cc6ba072780]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d] added
Apr 11 20:40:09 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d822e33-d642-4c0a-ab50-79fb30ad22bb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a36f7-c57d-4987-87ec-776894795b13]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxkQPVhf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxkQPVhf" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5df16d-a474-4036-bb3d-3c7f3644ba8a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxkQPVhf'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e6261-525a-43d6-b966-26f50caf377a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a04b04-165e-4959-9baf-3f83ac5e8acd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f017be32-bb7d-4932-89e3-cf6c60077475]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260]
Apr 11 20:40:09 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260] successful.
Apr 11 20:40:09 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70aee7c-567d-44ee-9f9c-ca7ce9f169d4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd21191b-4a0f-4786-95b2-0edb3199a2b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:40:09 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:09 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:40:09 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1583455e-59ab-4a15-b5dd-f2c112e6d82f]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:40:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxkQPVhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26133636236656139', 'path': '/dev/sdf'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133636236656139', 'path': '/dev/sdf'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgUhjnXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:40:10 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:40:10 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:40:10 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ff032-b14c-4595-9f33-4bf87bb44fac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:40:10 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bd8946-18e2-4cf9-8264-53304bad1c7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59] added
Apr 11 20:40:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efebdc6-0820-4a78-9589-38b2e1c1fd2f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[632dc35d-07fe-4916-bbf6-fcfb4b97b381]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgUhjnXD {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgUhjnXD" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[76436bee-36c4-4f31-ae8b-20f054830df9]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgUhjnXD'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce7c6ec-2906-4e24-b773-0d47e133c104]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37234d7-1816-4d79-bf48-474f6f5b2a68]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:40:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:40:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbfc60f-82fa-4105-bf7a-83d6425ce797]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260]
Apr 11 20:40:11 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260] successful.
Apr 11 20:40:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cb127-f1cb-43f3-a794-d8b460344566]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c950dde-458f-4eab-8d13-d33f5a54ac41]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:40:11 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:40:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba65b36b-4822-4e2a-a0fc-33b1a2ec3007]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:11 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:40:12 user nova-compute[71654]: INFO nova.compute.claims [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Claim successful on node user
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgUhjnXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23631346633346336', 'path': '/dev/sdg'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346633346336', 'path': '/dev/sdg'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lazy-loading 'pci_devices' on Instance uuid 921fec20-d5dc-4387-b265-2d16a1c226f2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:40:12 user nova-compute[71654]:   <uuid>921fec20-d5dc-4387-b265-2d16a1c226f2</uuid>
Apr 11 20:40:12 user nova-compute[71654]:   <name>instance-0000000c</name>
Apr 11 20:40:12 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:40:12 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:40:12 user nova-compute[71654]:   <metadata>
Apr 11 20:40:12 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:40:12 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:40:12 user nova-compute[71654]:       <nova:name>tempest-device-tagging-server-902658976</nova:name>
Apr 11 20:40:12 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:40:07</nova:creationTime>
Apr 11 20:40:12 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:40:12 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:40:12 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:40:12 user nova-compute[71654]:       <nova:owner>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:user uuid="928391a137c94107af4dd426b9a086f7">tempest-TaggedBootDevicesTest_v242-280116242-project-member</nova:user>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:project uuid="d89f013fadbe411caf0a6f2856a11135">tempest-TaggedBootDevicesTest_v242-280116242</nova:project>
Apr 11 20:40:12 user nova-compute[71654]:       </nova:owner>
Apr 11 20:40:12 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:40:12 user nova-compute[71654]:       <nova:ports>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="893b51e3-f5e5-41fa-aa56-913f6518dd5c">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="4af039ce-a832-46f5-9c67-e57a075dec43">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="fa937413-1cdc-4426-8707-25d48f79124c">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="6c831b68-dcd0-4ed9-8b7e-1b192ebd025a">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="1380e6a6-4036-442f-8120-243f80c0e646">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="c20d2e13-a748-4cdd-9ba0-5350f331d56b">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:         <nova:port uuid="030dae9d-cc5b-4278-935b-b032bf6d29dd">
Apr 11 20:40:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 20:40:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:12 user nova-compute[71654]:       </nova:ports>
Apr 11 20:40:12 user nova-compute[71654]:     </nova:instance>
Apr 11 20:40:12 user nova-compute[71654]:   </metadata>
Apr 11 20:40:12 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:40:12 user nova-compute[71654]:     <system>
Apr 11 20:40:12 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:40:12 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:40:12 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:40:12 user nova-compute[71654]:       <entry name="serial">921fec20-d5dc-4387-b265-2d16a1c226f2</entry>
Apr 11 20:40:12 user nova-compute[71654]:       <entry name="uuid">921fec20-d5dc-4387-b265-2d16a1c226f2</entry>
Apr 11 20:40:12 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:40:12 user nova-compute[71654]:     </system>
Apr 11 20:40:12 user nova-compute[71654]:   </sysinfo>
Apr 11 20:40:12 user nova-compute[71654]:   <os>
Apr 11 20:40:12 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:40:12 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:40:12 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:40:12 user nova-compute[71654]:   </os>
Apr 11 20:40:12 user nova-compute[71654]:   <features>
Apr 11 20:40:12 user nova-compute[71654]:     <acpi/>
Apr 11 20:40:12 user nova-compute[71654]:     <apic/>
Apr 11 20:40:12 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:40:12 user nova-compute[71654]:   </features>
Apr 11 20:40:12 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:40:12 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:40:12 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:40:12 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:40:12 user nova-compute[71654]:   </clock>
Apr 11 20:40:12 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:40:12 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:40:12 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:40:12 user nova-compute[71654]:   </cpu>
Apr 11 20:40:12 user nova-compute[71654]:   <devices>
Apr 11 20:40:12 user nova-compute[71654]:     <disk type="file" device="cdrom">
Apr 11 20:40:12 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 20:40:12 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2/disk.config"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="hda" bus="ide"/>
Apr 11 20:40:12 user nova-compute[71654]:     </disk>
Apr 11 20:40:12 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:40:12 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:40:12 user nova-compute[71654]:       <source dev="/dev/sde"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <serial>0b80e2a1-e119-4c40-97c9-7d393ddf700c</serial>
Apr 11 20:40:12 user nova-compute[71654]:     </disk>
Apr 11 20:40:12 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:40:12 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:40:12 user nova-compute[71654]:       <source dev="/dev/sdf"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <serial>7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d</serial>
Apr 11 20:40:12 user nova-compute[71654]:     </disk>
Apr 11 20:40:12 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:40:12 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:40:12 user nova-compute[71654]:       <source dev="/dev/sdg"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="vdc" bus="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <serial>78e8c94c-6902-4769-9266-b990c406ce59</serial>
Apr 11 20:40:12 user nova-compute[71654]:     </disk>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:ec:13:ec"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tap893b51e3-f5"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:26:a7:1e"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tap4af039ce-a8"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:ff:cb:84"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tapfa937413-1c"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:94:58:51"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tap6c831b68-dc"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:4f:32:dd"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tap1380e6a6-40"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:99:d3:1c"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tapc20d2e13-a7"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:12 user nova-compute[71654]:       <mac address="fa:16:3e:a1:22:41"/>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:12 user nova-compute[71654]:       <target dev="tap030dae9d-cc"/>
Apr 11 20:40:12 user nova-compute[71654]:     </interface>
Apr 11 20:40:12 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:40:12 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2/console.log" append="off"/>
Apr 11 20:40:12 user nova-compute[71654]:     </serial>
Apr 11 20:40:12 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:40:12 user nova-compute[71654]:     <video>
Apr 11 20:40:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:12 user nova-compute[71654]:     </video>
Apr 11 20:40:12 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:40:12 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:40:12 user nova-compute[71654]:     </rng>
Apr 11 20:40:12 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:40:12 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:40:12 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:40:12 user nova-compute[71654]:     </memballoon>
Apr 11 20:40:12 user nova-compute[71654]:   </devices>
Apr 11 20:40:12 user nova-compute[71654]: </domain>
Apr 11 20:40:12 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap893b51e3-f5, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap893b51e3-f5, col_values=(('external_ids', {'iface-id': '893b51e3-f5e5-41fa-aa56-913f6518dd5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:13:ec', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4af039ce-a8, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4af039ce-a8, col_values=(('external_ids', {'iface-id': '4af039ce-a832-46f5-9c67-e57a075dec43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a7:1e', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa937413-1c, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa937413-1c, col_values=(('external_ids', {'iface-id': 'fa937413-1cdc-4426-8707-25d48f79124c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:cb:84', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c831b68-dc, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c831b68-dc, col_values=(('external_ids', {'iface-id': '6c831b68-dcd0-4ed9-8b7e-1b192ebd025a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:58:51', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1380e6a6-40, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1380e6a6-40, col_values=(('external_ids', {'iface-id': '1380e6a6-4036-442f-8120-243f80c0e646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:32:dd', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc20d2e13-a7, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc20d2e13-a7, col_values=(('external_ids', {'iface-id': 'c20d2e13-a748-4cdd-9ba0-5350f331d56b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:d3:1c', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap030dae9d-cc, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap030dae9d-cc, col_values=(('external_ids', {'iface-id': '030dae9d-cc5b-4278-935b-b032bf6d29dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:22:41', 'vm-uuid': '921fec20-d5dc-4387-b265-2d16a1c226f2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:12 user nova-compute[71654]: INFO os_vif [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc')
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.policy [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] No BDM found with device name hda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] No VIF found with MAC fa:16:3e:ec:13:ec, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] No VIF found with MAC fa:16:3e:4f:32:dd, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:40:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Using config drive
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:40:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Creating image(s)
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Creating config drive at /opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2/disk.config
Apr 11 20:40:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpodaxm773 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.273s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpodaxm773" returned: 0 in 0.084s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk 1073741824" returned: 0 in 0.065s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Successfully created port: 29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.161s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Cannot resize image /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'migration_context' on Instance uuid f1d5f91c-afaa-456a-97e7-0460b1748d79 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Ensure instance console log exists: /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Successfully updated port: 29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-changed-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Refreshing instance network info cache due to event network-changed-29039955-eab6-420c-aa2c-dbd6326814c4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Acquiring lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Instance network_info: |[{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Acquired lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Refreshing network info cache for port 29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Start _get_guest_xml network_info=[{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:40:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:14 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-44480822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-44480822',id=13,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-3vvqecr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:40:13Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=f1d5f91c-afaa-456a-97e7-0460b1748d79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'pci_devices' on Instance uuid f1d5f91c-afaa-456a-97e7-0460b1748d79 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:40:14 user nova-compute[71654]:   <uuid>f1d5f91c-afaa-456a-97e7-0460b1748d79</uuid>
Apr 11 20:40:14 user nova-compute[71654]:   <name>instance-0000000d</name>
Apr 11 20:40:14 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:40:14 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:40:14 user nova-compute[71654]:   <metadata>
Apr 11 20:40:14 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:40:14 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:40:14 user nova-compute[71654]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-44480822</nova:name>
Apr 11 20:40:14 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:40:14</nova:creationTime>
Apr 11 20:40:14 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:40:14 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:40:14 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:40:14 user nova-compute[71654]:       <nova:owner>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:user uuid="1d5cb62cc3844248be2e4456d970ccdf">tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member</nova:user>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:project uuid="85bf8fe34838426ea05060463458e5e0">tempest-ServerBootFromVolumeStableRescueTest-243239500</nova:project>
Apr 11 20:40:14 user nova-compute[71654]:       </nova:owner>
Apr 11 20:40:14 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:40:14 user nova-compute[71654]:       <nova:ports>
Apr 11 20:40:14 user nova-compute[71654]:         <nova:port uuid="29039955-eab6-420c-aa2c-dbd6326814c4">
Apr 11 20:40:14 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 20:40:14 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:14 user nova-compute[71654]:       </nova:ports>
Apr 11 20:40:14 user nova-compute[71654]:     </nova:instance>
Apr 11 20:40:14 user nova-compute[71654]:   </metadata>
Apr 11 20:40:14 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:40:14 user nova-compute[71654]:     <system>
Apr 11 20:40:14 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:40:14 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:40:14 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:40:14 user nova-compute[71654]:       <entry name="serial">f1d5f91c-afaa-456a-97e7-0460b1748d79</entry>
Apr 11 20:40:14 user nova-compute[71654]:       <entry name="uuid">f1d5f91c-afaa-456a-97e7-0460b1748d79</entry>
Apr 11 20:40:14 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:40:14 user nova-compute[71654]:     </system>
Apr 11 20:40:14 user nova-compute[71654]:   </sysinfo>
Apr 11 20:40:14 user nova-compute[71654]:   <os>
Apr 11 20:40:14 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:40:14 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:40:14 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:40:14 user nova-compute[71654]:   </os>
Apr 11 20:40:14 user nova-compute[71654]:   <features>
Apr 11 20:40:14 user nova-compute[71654]:     <acpi/>
Apr 11 20:40:14 user nova-compute[71654]:     <apic/>
Apr 11 20:40:14 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:40:14 user nova-compute[71654]:   </features>
Apr 11 20:40:14 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:40:14 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:40:14 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:40:14 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:40:14 user nova-compute[71654]:   </clock>
Apr 11 20:40:14 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:40:14 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:40:14 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:40:14 user nova-compute[71654]:   </cpu>
Apr 11 20:40:14 user nova-compute[71654]:   <devices>
Apr 11 20:40:14 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:40:14 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:40:14 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk"/>
Apr 11 20:40:14 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:40:14 user nova-compute[71654]:     </disk>
Apr 11 20:40:14 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:14 user nova-compute[71654]:       <mac address="fa:16:3e:42:7e:1a"/>
Apr 11 20:40:14 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:14 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:14 user nova-compute[71654]:       <target dev="tap29039955-ea"/>
Apr 11 20:40:14 user nova-compute[71654]:     </interface>
Apr 11 20:40:14 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:40:14 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/console.log" append="off"/>
Apr 11 20:40:14 user nova-compute[71654]:     </serial>
Apr 11 20:40:14 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:40:14 user nova-compute[71654]:     <video>
Apr 11 20:40:14 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:14 user nova-compute[71654]:     </video>
Apr 11 20:40:14 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:40:14 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:40:14 user nova-compute[71654]:     </rng>
Apr 11 20:40:14 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:40:14 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:40:14 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:40:14 user nova-compute[71654]:     </memballoon>
Apr 11 20:40:14 user nova-compute[71654]:   </devices>
Apr 11 20:40:14 user nova-compute[71654]: </domain>
Apr 11 20:40:14 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-44480822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-44480822',id=13,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-3vvqecr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:40:13Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=f1d5f91c-afaa-456a-97e7-0460b1748d79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG os_vif [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29039955-ea, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29039955-ea, col_values=(('external_ids', {'iface-id': '29039955-eab6-420c-aa2c-dbd6326814c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:7e:1a', 'vm-uuid': 'f1d5f91c-afaa-456a-97e7-0460b1748d79'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:14 user nova-compute[71654]: INFO os_vif [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea')
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No VIF found with MAC fa:16:3e:42:7e:1a, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:15 user nova-compute[71654]: WARNING nova.compute.manager [req-ad9507bf-5b2e-42ce-9c12-8e99937877ac req-264c5c21-71ed-4ffe-9d82-07cc1417ebae service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance with vm_state building and task_state spawning.
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG nova.network.neutron [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updated VIF entry in instance network info cache for port 29039955-eab6-420c-aa2c-dbd6326814c4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG nova.network.neutron [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6c010034-9f69-4f97-9023-1774eb402c05 req-d57e2821-1ee1-4bfc-ae00-fe6c2aebe18c service nova] Releasing lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:16 user nova-compute[71654]: WARNING nova.compute.manager [req-a076c906-2b6f-41e9-adc8-fa33554bf8f6 req-d1025901-4c72-4726-81fe-25676ce542f3 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 for instance with vm_state building and task_state spawning.
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:17 user nova-compute[71654]: WARNING nova.compute.manager [req-0782da86-fccf-4351-a2ee-1aa30a89f536 req-c056e7e6-700e-4284-b18e-125e3d8ef6ce service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance with vm_state building and task_state spawning.
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] No waiting events found dispatching network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:17 user nova-compute[71654]: WARNING nova.compute.manager [req-3db7e512-7eac-4120-a4a1-e1ac17f897b3 req-d1f0b91d-90c2-4457-922a-32837302e4ce service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received unexpected event network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 for instance with vm_state building and task_state spawning.
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:18 user nova-compute[71654]: WARNING nova.compute.manager [req-e2146492-9b63-4055-ad42-14031d709f67 req-f8179c01-bfa9-4705-bdbf-98170ee8b738 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 for instance with vm_state building and task_state spawning.
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:19 user nova-compute[71654]: WARNING nova.compute.manager [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance with vm_state building and task_state spawning.
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:19 user nova-compute[71654]: WARNING nova.compute.manager [req-b3b8393f-4253-4502-bb8d-a9030f1c4cb6 req-0f04ec4c-d0be-46a8-a35c-9b96ec11b861 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance with vm_state building and task_state spawning.
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] No waiting events found dispatching network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:19 user nova-compute[71654]: WARNING nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received unexpected event network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 for instance with vm_state building and task_state spawning.
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:19 user nova-compute[71654]: WARNING nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd for instance with vm_state building and task_state spawning.
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:19 user nova-compute[71654]: WARNING nova.compute.manager [req-34447111-6763-46f5-9941-1b489f4371bb req-09ecdd67-f078-4929-9872-181291ea7ed0 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd for instance with vm_state building and task_state spawning.
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.claims [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Claim successful on node user
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245620.6933284, f1d5f91c-afaa-456a-97e7-0460b1748d79 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] VM Resumed (Lifecycle Event)
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Instance spawned successfully.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance spawned successfully.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245620.7034857, f1d5f91c-afaa-456a-97e7-0460b1748d79 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] VM Started (Lifecycle Event)
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Took 8.10 seconds to spawn the instance on the hypervisor.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Took 14.08 seconds to spawn the instance on the hypervisor.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245620.7041612, 921fec20-d5dc-4387-b265-2d16a1c226f2 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] VM Resumed (Lifecycle Event)
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245620.7042248, 921fec20-d5dc-4387-b265-2d16a1c226f2 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] VM Started (Lifecycle Event)
Apr 11 20:40:20 user nova-compute[71654]: INFO nova.compute.manager [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Took 8.87 seconds to build instance.
Apr 11 20:40:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6a6e0f01-6fea-4099-b78a-a9f332040624 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.999s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:40:21 user nova-compute[71654]: INFO nova.compute.manager [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Took 30.59 seconds to build instance.
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ddab2ad5-e3ce-4cfb-9f6b-d2ee8fae319a tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.720s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:40:21 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.policy [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:40:21 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Creating image(s)
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.157s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk 1073741824" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Successfully created port: 087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.630s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:40:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7975MB free_disk=26.510169982910156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Cannot resize image /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.objects.instance [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'migration_context' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Ensure instance console log exists: /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 6af82381-69fc-47e5-a16f-cea88c569240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:40:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Successfully updated port: 087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-changed-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Refreshing instance network info cache due to event network-changed-087e4499-cfde-448a-b093-08f4b879f946. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:40:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance network_info: |[{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Refreshing network info cache for port 087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start _get_guest_xml network_info=[{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:40:24 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:24 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.objects.instance [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'pci_devices' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:40:24 user nova-compute[71654]:   <uuid>9613dc9f-5683-4139-bbed-0c2a11c2dc31</uuid>
Apr 11 20:40:24 user nova-compute[71654]:   <name>instance-0000000e</name>
Apr 11 20:40:24 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:40:24 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:40:24 user nova-compute[71654]:   <metadata>
Apr 11 20:40:24 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:40:24 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:40:24 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeTestJSON-server-1899891318</nova:name>
Apr 11 20:40:24 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:40:24</nova:creationTime>
Apr 11 20:40:24 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:40:24 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:40:24 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:40:24 user nova-compute[71654]:       <nova:owner>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:user uuid="3c9f583cc98040bc822e1ac7e418aa98">tempest-AttachVolumeTestJSON-968541948-project-member</nova:user>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:project uuid="426d5e042ba34969a2bfdc0c89da11e8">tempest-AttachVolumeTestJSON-968541948</nova:project>
Apr 11 20:40:24 user nova-compute[71654]:       </nova:owner>
Apr 11 20:40:24 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:40:24 user nova-compute[71654]:       <nova:ports>
Apr 11 20:40:24 user nova-compute[71654]:         <nova:port uuid="087e4499-cfde-448a-b093-08f4b879f946">
Apr 11 20:40:24 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 20:40:24 user nova-compute[71654]:         </nova:port>
Apr 11 20:40:24 user nova-compute[71654]:       </nova:ports>
Apr 11 20:40:24 user nova-compute[71654]:     </nova:instance>
Apr 11 20:40:24 user nova-compute[71654]:   </metadata>
Apr 11 20:40:24 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:40:24 user nova-compute[71654]:     <system>
Apr 11 20:40:24 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:40:24 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:40:24 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:40:24 user nova-compute[71654]:       <entry name="serial">9613dc9f-5683-4139-bbed-0c2a11c2dc31</entry>
Apr 11 20:40:24 user nova-compute[71654]:       <entry name="uuid">9613dc9f-5683-4139-bbed-0c2a11c2dc31</entry>
Apr 11 20:40:24 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:40:24 user nova-compute[71654]:     </system>
Apr 11 20:40:24 user nova-compute[71654]:   </sysinfo>
Apr 11 20:40:24 user nova-compute[71654]:   <os>
Apr 11 20:40:24 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:40:24 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:40:24 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:40:24 user nova-compute[71654]:   </os>
Apr 11 20:40:24 user nova-compute[71654]:   <features>
Apr 11 20:40:24 user nova-compute[71654]:     <acpi/>
Apr 11 20:40:24 user nova-compute[71654]:     <apic/>
Apr 11 20:40:24 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:40:24 user nova-compute[71654]:   </features>
Apr 11 20:40:24 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:40:24 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:40:24 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:40:24 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:40:24 user nova-compute[71654]:   </clock>
Apr 11 20:40:24 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:40:24 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:40:24 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:40:24 user nova-compute[71654]:   </cpu>
Apr 11 20:40:24 user nova-compute[71654]:   <devices>
Apr 11 20:40:24 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:40:24 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:40:24 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk"/>
Apr 11 20:40:24 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:40:24 user nova-compute[71654]:     </disk>
Apr 11 20:40:24 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:40:24 user nova-compute[71654]:       <mac address="fa:16:3e:1a:3b:8b"/>
Apr 11 20:40:24 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:24 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:40:24 user nova-compute[71654]:       <target dev="tap087e4499-cf"/>
Apr 11 20:40:24 user nova-compute[71654]:     </interface>
Apr 11 20:40:24 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:40:24 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/console.log" append="off"/>
Apr 11 20:40:24 user nova-compute[71654]:     </serial>
Apr 11 20:40:24 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:40:24 user nova-compute[71654]:     <video>
Apr 11 20:40:24 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:40:24 user nova-compute[71654]:     </video>
Apr 11 20:40:24 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:40:24 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:40:24 user nova-compute[71654]:     </rng>
Apr 11 20:40:24 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:40:24 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:40:24 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:40:24 user nova-compute[71654]:     </memballoon>
Apr 11 20:40:24 user nova-compute[71654]:   </devices>
Apr 11 20:40:24 user nova-compute[71654]: </domain>
Apr 11 20:40:24 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG os_vif [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap087e4499-cf, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap087e4499-cf, col_values=(('external_ids', {'iface-id': '087e4499-cfde-448a-b093-08f4b879f946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:3b:8b', 'vm-uuid': '9613dc9f-5683-4139-bbed-0c2a11c2dc31'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:24 user nova-compute[71654]: INFO os_vif [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf')
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No VIF found with MAC fa:16:3e:1a:3b:8b, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updated VIF entry in instance network info cache for port 087e4499-cfde-448a-b093-08f4b879f946. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f53dbea0-193d-4efb-a870-50e1586f8f5e req-839fd545-ce4d-4153-92c6-8b8743e520a6 service nova] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updating instance_info_cache with network_info: [{"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-52b7250e-a85d-4c3f-93e7-ac05ebd13be1" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:40:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:40:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:26 user nova-compute[71654]: WARNING nova.compute.manager [req-bf375e90-27ba-45e1-bcbc-ec0b098f1ca5 req-67715390-8e7f-41d3-a287-f15acb161b10 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state building and task_state spawning.
Apr 11 20:40:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245628.2069905, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Resumed (Lifecycle Event)
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance spawned successfully.
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245628.213315, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Started (Lifecycle Event)
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:28 user nova-compute[71654]: WARNING nova.compute.manager [req-6d4d51d1-75d2-4a2a-8176-ed5181236dc1 req-3582b513-b54e-41e9-94a6-6c9d00c3ebb8 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state building and task_state spawning.
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Took 7.15 seconds to spawn the instance on the hypervisor.
Apr 11 20:40:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:28 user nova-compute[71654]: INFO nova.compute.manager [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Took 8.07 seconds to build instance.
Apr 11 20:40:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-49563371-0b4f-42b1-b935-f516580c7b89 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.162s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:35 user nova-compute[71654]: INFO nova.compute.manager [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Terminating instance
Apr 11 20:40:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-vif-unplugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] No waiting events found dispatching network-vif-unplugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-f888e8cd-3c3c-4262-81f3-bb9a8fe6b0fd req-41944513-39e5-4d3f-8fa1-eef9199ea3e6 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-vif-unplugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Instance destroyed successfully.
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'resources' on Instance uuid 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-566404294',display_name='tempest-VolumesAdminNegativeTest-server-566404294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-566404294',id=10,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab02b2eef8d40f18b755b63d2a14c9b',ramdisk_id='',reservation_id='r-y29x06xp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-878898162',owner_user_name='tempest-VolumesAdminNegativeTest-878898162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:38:50Z,user_data=None,user_id='af25924dd6564739a52fd957edceb143',uuid=44b8fa17-6b3b-42ea-84ee-06a9beca49b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converting VIF {"id": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "address": "fa:16:3e:14:13:1a", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0443e27-a7", "ovs_interfaceid": "c0443e27-a70c-4bb3-8650-ffe89cbb9c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG os_vif [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0443e27-a7, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:36 user nova-compute[71654]: INFO os_vif [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:13:1a,bridge_name='br-int',has_traffic_filtering=True,id=c0443e27-a70c-4bb3-8650-ffe89cbb9c59,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0443e27-a7')
Apr 11 20:40:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Deleting instance files /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4_del
Apr 11 20:40:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Deletion of /opt/stack/data/nova/instances/44b8fa17-6b3b-42ea-84ee-06a9beca49b4_del complete
Apr 11 20:40:36 user nova-compute[71654]: INFO nova.compute.manager [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 11 20:40:36 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:40:36 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:40:37 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:40:37 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Took 0.60 seconds to deallocate network for instance.
Apr 11 20:40:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:37 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:40:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:40:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:37 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Deleted allocations for instance 44b8fa17-6b3b-42ea-84ee-06a9beca49b4
Apr 11 20:40:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b71f4a82-fb47-4843-802c-3e0b9154901b tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Acquiring lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:40:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:40:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] Lock "44b8fa17-6b3b-42ea-84ee-06a9beca49b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:40:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] No waiting events found dispatching network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:40:38 user nova-compute[71654]: WARNING nova.compute.manager [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received unexpected event network-vif-plugged-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 for instance with vm_state deleted and task_state None.
Apr 11 20:40:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-10b3f45a-d9c5-4393-a4bb-4af02b431481 req-2f9404c4-709b-49da-bf60-458e5c9968a2 service nova] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Received event network-vif-deleted-c0443e27-a70c-4bb3-8650-ffe89cbb9c59 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:40:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:51 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245636.6852062, 44b8fa17-6b3b-42ea-84ee-06a9beca49b4 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:40:51 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] VM Stopped (Lifecycle Event)
Apr 11 20:40:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3a3f8dfa-db82-4fcd-b287-010d15b354c4 None None] [instance: 44b8fa17-6b3b-42ea-84ee-06a9beca49b4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:40:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:40:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:03 user nova-compute[71654]: INFO nova.compute.manager [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Detaching volume ac687e43-f85e-48a9-bbbe-69afaba2ec38
Apr 11 20:41:03 user nova-compute[71654]: INFO nova.virt.block_device [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Attempting to driver detach volume ac687e43-f85e-48a9-bbbe-69afaba2ec38 from mountpoint /dev/vdc
Apr 11 20:41:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Attempting to detach device vdc from instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:41:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:41:03 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:41:03 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 20:41:03 user nova-compute[71654]:   <target dev="vdc" bus="virtio"/>
Apr 11 20:41:03 user nova-compute[71654]:   <serial>ac687e43-f85e-48a9-bbbe-69afaba2ec38</serial>
Apr 11 20:41:03 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:41:03 user nova-compute[71654]: </disk>
Apr 11 20:41:03 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:41:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully detached device vdc from instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 from the persistent domain config.
Apr 11 20:41:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:41:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:41:03 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:41:03 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 20:41:03 user nova-compute[71654]:   <target dev="vdc" bus="virtio"/>
Apr 11 20:41:03 user nova-compute[71654]:   <serial>ac687e43-f85e-48a9-bbbe-69afaba2ec38</serial>
Apr 11 20:41:03 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:41:03 user nova-compute[71654]: </disk>
Apr 11 20:41:03 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:41:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'flavor' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:04 user nova-compute[71654]: INFO nova.compute.manager [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Attaching volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 to /dev/vdb
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.utils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[609e8073-6ddd-4177-b9c4-19371a32c461]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6aca1f-db2f-4e31-b773-a4c910e90987]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[422bda84-0d42-4186-9ccd-7a4a0242c4fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e58ca-2485-4183-8324-43afb56f5d76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:41:04 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fe0ac0-9c6d-48e8-a738-e07aa4b18c8b]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.utils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating existing volume attachment record: 059d16ed-ee8c-4acf-a4af-11a9cc29dbc3 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245664.409262, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:41:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully detached device vdc from instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 from the live domain config.
Apr 11 20:41:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnfsugtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:04 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7236e-48b7-4c5b-a922-8c2b1d4f4d1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:41:04 user nova-compute[71654]: No targets found.
Apr 11 20:41:04 user nova-compute[71654]: iSNS:
Apr 11 20:41:04 user nova-compute[71654]: No targets found.
Apr 11 20:41:04 user nova-compute[71654]: STATIC:
Apr 11 20:41:04 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c
Apr 11 20:41:04 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:04 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:04 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:41:04 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:04 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:04 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38
Apr 11 20:41:04 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:04 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:04 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:04 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:04 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:04 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59
Apr 11 20:41:04 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:04 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:04 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d
Apr 11 20:41:04 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:04 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:04 user nova-compute[71654]: FIRMWARE:
Apr 11 20:41:04 user nova-compute[71654]: No targets found.
Apr 11 20:41:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:41:04 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:41:04 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d0163-2a4b-4741-be2f-21f70bae3a50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd30c36-5242-439d-b302-e92320a2c7f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:04 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb402df010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e8bc8-0cea-434e-90c6-4b8197c204c6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68cc75b-c6eb-4740-868a-ffb8289c5ffe]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e30fc34-3eaa-4ebc-a710-f757abad5efa]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b600e-0c64-4507-93f5-5b81af39ca7b]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ecf641-2314-4072-abea-82d9fda45190]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a931fb-9737-474e-97a0-d3205078892e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260]
Apr 11 20:41:04 user nova-compute[71654]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac687e43-f85e-48a9-bbbe-69afaba2ec38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d9f3a-c548-4d33-ae9d-141de6f6cedc]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] <== disconnect_volume: return (312ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:41:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'flavor' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ac6257d-d31f-438c-b8ab-1cdd06c410fe tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.806s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:07 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 20:41:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:08 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:08 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:08 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[89965e15-5aa9-4a63-8848-a65ae170b984]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:41:08 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2a8d9-2bbd-44fb-a21f-718bf09b3c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546] added
Apr 11 20:41:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39a423-178e-4c44-be01-f4f18f7ecd3a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c12e15-77b8-4d8b-96f7-a28dcdd190b7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPinzWTR {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPinzWTR" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cde764c-d04a-4609-8b61-39d57b84e682]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPinzWTR'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9117c08a-8cfc-4843-a329-1af8c09603a7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049fd78-108f-48b8-8bb3-ecad33a471f2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a3816-bbb7-4b12-b1bd-533062870ff4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]
Apr 11 20:41:08 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f347ffa-d7f6-43f7-b5df-73c006c276dc]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4a59ab-c034-4305-8f12-c703917b79f1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:08 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[355f0775-51c7-4715-93eb-5cf6d60dc25c]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:08 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26334613035616364', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334613035616364', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG nova.objects.instance [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'flavor' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:41:09 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:41:09 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 20:41:09 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:41:09 user nova-compute[71654]:   <serial>1f60ce4f-bf85-446c-bc26-6af1cc7dc546</serial>
Apr 11 20:41:09 user nova-compute[71654]: </disk>
Apr 11 20:41:09 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:41:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:41:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:41:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No VIF found with MAC fa:16:3e:5f:2d:da, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:41:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa81e04d-1d2e-49b7-80cc-286f55c334cc tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.360s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:11 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:12 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing instance network info cache due to event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updated VIF entry in instance network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7cd04321-be99-458b-991f-506883203571 req-22651596-0094-472a-8b33-e4c30d811ece service nova] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:14 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing instance network info cache due to event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG nova.network.neutron [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:41:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG nova.network.neutron [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updated VIF entry in instance network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG nova.network.neutron [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1b08bd75-62f8-4dc6-b888-0cbc58df420c req-9ee62798-b236-4a0f-9b91-7de15bee1ee5 service nova] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:17 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:18 user nova-compute[71654]: INFO nova.compute.manager [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Rebooting instance
Apr 11 20:41:18 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:41:18 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7824MB free_disk=26.485992431640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 6af82381-69fc-47e5-a16f-cea88c569240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-unplugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-unplugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:18 user nova-compute[71654]: WARNING nova.compute.manager [req-58ba16f9-af6d-49ef-ab6a-04651c865d3c req-2611b86b-002d-4218-be57-291ac06d5f8a service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-unplugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state active and task_state reboot_started_hard.
Apr 11 20:41:19 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance destroyed successfully.
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'resources' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1961006747',display_name='tempest-TestMinimumBasicScenario-server-1961006747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1961006747',id=11,image_ref='34247816-448f-4660-9d3b-31800b7e69d9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ==',key_name='tempest-TestMinimumBasicScenario-338876043',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-7jdekc70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34247816-448f-4660-9d3b-31800b7e69d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:41:19Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=6af82381-69fc-47e5-a16f-cea88c569240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcff9d1b4-18, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:19 user nova-compute[71654]: INFO os_vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18')
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:19 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6af8eab-7aa4-4028-ab1d-5a893097af6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:41:19 user nova-compute[71654]: No targets found.
Apr 11 20:41:19 user nova-compute[71654]: iSNS:
Apr 11 20:41:19 user nova-compute[71654]: No targets found.
Apr 11 20:41:19 user nova-compute[71654]: STATIC:
Apr 11 20:41:19 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c
Apr 11 20:41:19 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:19 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:19 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:41:19 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:19 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:19 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:41:19 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:19 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:19 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:19 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:19 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:19 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59
Apr 11 20:41:19 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:19 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:19 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d
Apr 11 20:41:19 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:19 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:19 user nova-compute[71654]: FIRMWARE:
Apr 11 20:41:19 user nova-compute[71654]: No targets found.
Apr 11 20:41:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:41:19 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:41:19 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c755372-cc57-4c6c-8f53-7e00ac91556f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfffa81-49e3-4b9a-9f27-29dbc89656ae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:19 user nova-compute[71654]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e7f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6862dc06-587c-46a0-8b3c-07f7bb6ee7d7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[88332aae-164d-454a-9435-2ebb119820f5]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a8fd6-f5d4-47b4-8689-77567e9a4c71]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab87ba3-4d47-428a-a73d-bbc14fbbc88f]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f932fb66-3694-47cb-b41a-5b712456ed65]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b6bcc2-d7ea-4d21-8aeb-5ef7b15531cf]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]
Apr 11 20:41:19 user nova-compute[71654]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:41:19 user nova-compute[71654]: INFO nova.compute.manager [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Unrescuing
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.network.neutron [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ae85f-70c3-4047-8908-3b01dc4240ef]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== disconnect_volume: return (317ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Start _get_guest_xml network_info=[{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34247816-448f-4660-9d3b-31800b7e69d9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '34247816-448f-4660-9d3b-31800b7e69d9'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6af82381-69fc-47e5-a16f-cea88c569240', 'attached_at': '', 'detached_at': '', 'volume_id': '1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'serial': '1f60ce4f-bf85-446c-bc26-6af1cc7dc546'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '059d16ed-ee8c-4acf-a4af-11a9cc29dbc3', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:41:19 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:41:19 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=34247816-448f-4660-9d3b-31800b7e69d9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:19 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:19 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:19 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f392080e-68fa-4ba7-84c3-0833082b0b2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:41:19 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc68bde-d315-4968-8dd4-672fa10dac56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546] added
Apr 11 20:41:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[075106f9-ff45-4c5f-90fd-cf0211fcd600]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6beb7-e2b7-4431-8038-a16b88d42148]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPinzWTR {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPinzWTR" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a18bb10-5b80-418d-a644-2b456a81911f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPinzWTR'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b092e00-0b42-4918-a0b4-4d94230bf10a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e09c6c3-c841-4374-a03d-5a508b494bec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a45764-a9a9-49ba-bb9f-e079ad6f3dab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]
Apr 11 20:41:20 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:20 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce9746b-8b74-40a6-a4a3-40b2c8ba32a5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fd80a7-72f7-4f4e-b68d-092839e4794f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:20 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcdeeea-ce2f-4528-b3ea-afa15b95fc83]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.objects.instance [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'flavor' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing instance network info cache due to event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.network.neutron [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:20 user nova-compute[71654]: WARNING nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state active and task_state reboot_started_hard.
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:20 user nova-compute[71654]: WARNING nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:20 user nova-compute[71654]: WARNING nova.compute.manager [req-6fbeb800-d1ca-4125-ba3d-83a8e96db111 req-1e204458-260e-4e95-a1fd-441b67ca5e62 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:41:21 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance destroyed successfully.
Apr 11 20:41:21 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26334613035616364', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334613035616364', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1961006747',display_name='tempest-TestMinimumBasicScenario-server-1961006747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1961006747',id=11,image_ref='34247816-448f-4660-9d3b-31800b7e69d9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ==',key_name='tempest-TestMinimumBasicScenario-338876043',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-7jdekc70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34247816-448f-4660-9d3b-31800b7e69d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:41:19Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=6af82381-69fc-47e5-a16f-cea88c569240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'pci_devices' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:41:21 user nova-compute[71654]:   <uuid>6af82381-69fc-47e5-a16f-cea88c569240</uuid>
Apr 11 20:41:21 user nova-compute[71654]:   <name>instance-0000000b</name>
Apr 11 20:41:21 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:41:21 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:41:21 user nova-compute[71654]:   <metadata>
Apr 11 20:41:21 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:41:21 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:41:21 user nova-compute[71654]:       <nova:name>tempest-TestMinimumBasicScenario-server-1961006747</nova:name>
Apr 11 20:41:21 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:41:19</nova:creationTime>
Apr 11 20:41:21 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:41:21 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:41:21 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:41:21 user nova-compute[71654]:       <nova:owner>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:user uuid="0a70ed7ce13442e6b7f6f62b960520ad">tempest-TestMinimumBasicScenario-2142191059-project-member</nova:user>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:project uuid="cdd62a4c803247588716e71c25c62b05">tempest-TestMinimumBasicScenario-2142191059</nova:project>
Apr 11 20:41:21 user nova-compute[71654]:       </nova:owner>
Apr 11 20:41:21 user nova-compute[71654]:       <nova:root type="image" uuid="34247816-448f-4660-9d3b-31800b7e69d9"/>
Apr 11 20:41:21 user nova-compute[71654]:       <nova:ports>
Apr 11 20:41:21 user nova-compute[71654]:         <nova:port uuid="cff9d1b4-18f3-4450-8d38-f230812fb66e">
Apr 11 20:41:21 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:41:21 user nova-compute[71654]:         </nova:port>
Apr 11 20:41:21 user nova-compute[71654]:       </nova:ports>
Apr 11 20:41:21 user nova-compute[71654]:     </nova:instance>
Apr 11 20:41:21 user nova-compute[71654]:   </metadata>
Apr 11 20:41:21 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:41:21 user nova-compute[71654]:     <system>
Apr 11 20:41:21 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:41:21 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:41:21 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:41:21 user nova-compute[71654]:       <entry name="serial">6af82381-69fc-47e5-a16f-cea88c569240</entry>
Apr 11 20:41:21 user nova-compute[71654]:       <entry name="uuid">6af82381-69fc-47e5-a16f-cea88c569240</entry>
Apr 11 20:41:21 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:41:21 user nova-compute[71654]:     </system>
Apr 11 20:41:21 user nova-compute[71654]:   </sysinfo>
Apr 11 20:41:21 user nova-compute[71654]:   <os>
Apr 11 20:41:21 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:41:21 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:41:21 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:41:21 user nova-compute[71654]:   </os>
Apr 11 20:41:21 user nova-compute[71654]:   <features>
Apr 11 20:41:21 user nova-compute[71654]:     <acpi/>
Apr 11 20:41:21 user nova-compute[71654]:     <apic/>
Apr 11 20:41:21 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:41:21 user nova-compute[71654]:   </features>
Apr 11 20:41:21 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:41:21 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:41:21 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:41:21 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:41:21 user nova-compute[71654]:   </clock>
Apr 11 20:41:21 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:41:21 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:41:21 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:41:21 user nova-compute[71654]:   </cpu>
Apr 11 20:41:21 user nova-compute[71654]:   <devices>
Apr 11 20:41:21 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:41:21 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:41:21 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk"/>
Apr 11 20:41:21 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:41:21 user nova-compute[71654]:     </disk>
Apr 11 20:41:21 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:41:21 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:41:21 user nova-compute[71654]:       <source dev="/dev/sdc"/>
Apr 11 20:41:21 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:41:21 user nova-compute[71654]:       <serial>1f60ce4f-bf85-446c-bc26-6af1cc7dc546</serial>
Apr 11 20:41:21 user nova-compute[71654]:     </disk>
Apr 11 20:41:21 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:41:21 user nova-compute[71654]:       <mac address="fa:16:3e:5f:2d:da"/>
Apr 11 20:41:21 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:41:21 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:41:21 user nova-compute[71654]:       <target dev="tapcff9d1b4-18"/>
Apr 11 20:41:21 user nova-compute[71654]:     </interface>
Apr 11 20:41:21 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:41:21 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/console.log" append="off"/>
Apr 11 20:41:21 user nova-compute[71654]:     </serial>
Apr 11 20:41:21 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:41:21 user nova-compute[71654]:     <video>
Apr 11 20:41:21 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:41:21 user nova-compute[71654]:     </video>
Apr 11 20:41:21 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:41:21 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:41:21 user nova-compute[71654]:     </rng>
Apr 11 20:41:21 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:41:21 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:41:21 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:41:21 user nova-compute[71654]:     </memballoon>
Apr 11 20:41:21 user nova-compute[71654]:   </devices>
Apr 11 20:41:21 user nova-compute[71654]: </domain>
Apr 11 20:41:21 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.network.neutron [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updated VIF entry in instance network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.network.neutron [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e36319f7-5869-40eb-a3fa-dbe64abf3ff1 req-b693a95c-6ad0-40e1-9579-94c6cd913506 service nova] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Cannot resize image /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'migration_context' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1961006747',display_name='tempest-TestMinimumBasicScenario-server-1961006747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1961006747',id=11,image_ref='34247816-448f-4660-9d3b-31800b7e69d9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ==',key_name='tempest-TestMinimumBasicScenario-338876043',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-7jdekc70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34247816-448f-4660-9d3b-31800b7e69d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:41:19Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=6af82381-69fc-47e5-a16f-cea88c569240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG os_vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcff9d1b4-18, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcff9d1b4-18, col_values=(('external_ids', {'iface-id': 'cff9d1b4-18f3-4450-8d38-f230812fb66e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:2d:da', 'vm-uuid': '6af82381-69fc-47e5-a16f-cea88c569240'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:21 user nova-compute[71654]: INFO os_vif [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18')
Apr 11 20:41:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing instance network info cache due to event network-changed-1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:41:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Acquiring lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Acquired lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Refreshing network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG nova.compute.manager [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:23 user nova-compute[71654]: WARNING nova.compute.manager [req-9058de53-4d7f-4d79-9809-4324568f8371 req-ff4c2a27-5d24-4252-9f64-2df72e64f473 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:41:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updated VIF entry in instance network info cache for port 1ef9bc31-64d9-48ac-b54c-80d0b4487897. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [{"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-049fedce-d2dd-41eb-bf16-6972e3d2884d req-49a338b7-4482-4e59-8c17-aeaf976236ea service nova] Releasing lock "refresh_cache-fe5fb157-6ca9-4e9f-87c6-11300909fdca" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:25 user nova-compute[71654]: WARNING nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:41:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:25 user nova-compute[71654]: WARNING nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state active and task_state reboot_started_hard.
Apr 11 20:41:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:25 user nova-compute[71654]: WARNING nova.compute.manager [req-c74d611a-2554-4729-a656-c59de0d699f1 req-9713b408-6097-4a5f-a2a1-8d6a3ebabce1 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state active and task_state reboot_started_hard.
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for fe5fb157-6ca9-4e9f-87c6-11300909fdca due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245686.5110276, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:41:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Resumed (Lifecycle Event)
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-42d0947a-74f2-4640-b2a8-416c7fd988c8 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:41:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance rebooted successfully.
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245686.5131361, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:41:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Started (Lifecycle Event)
Apr 11 20:41:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 6af82381-69fc-47e5-a16f-cea88c569240 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245686.534365, 6af82381-69fc-47e5-a16f-cea88c569240 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:41:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] VM Resumed (Lifecycle Event)
Apr 11 20:41:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a5cfd17a-16bb-451e-8760-cd63fa3853ed tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.623s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245686.5354564, 6af82381-69fc-47e5-a16f-cea88c569240 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:41:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] VM Started (Lifecycle Event)
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:41:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:28 user nova-compute[71654]: INFO nova.compute.manager [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Terminating instance
Apr 11 20:41:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-vif-unplugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] No waiting events found dispatching network-vif-unplugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-fe239c37-1bd4-4c62-bfd9-618fd4be2552 req-fac67e5d-21f2-4f92-8ba3-8f7208a62dd1 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-vif-unplugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Instance destroyed successfully.
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lazy-loading 'resources' on Instance uuid 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1907534775',display_name='tempest-VolumesAdminNegativeTest-server-1907534775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1907534775',id=6,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW/t9YZ66Cz3VZyVg3QGLDVCdTkc7Tgb97mAXHXYB6LoyZLSe0s0IjH7upGLuhJ75+s83H49TRIFzJlt1rme3byHdLvFn1IUIl2DAKKNpuUl7UzAvXGLqeDLFOTod8Glg==',key_name='tempest-keypair-189322231',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:35:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ab02b2eef8d40f18b755b63d2a14c9b',ramdisk_id='',reservation_id='r-2tzun3oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-878898162',owner_user_name='tempest-VolumesAdminNegativeTest-878898162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af25924dd6564739a52fd957edceb143',uuid=52b7250e-a85d-4c3f-93e7-ac05ebd13be1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converting VIF {"id": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "address": "fa:16:3e:44:b5:bf", "network": {"id": "f8c05312-c164-4467-85c1-b6d6a33e43db", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33660021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ab02b2eef8d40f18b755b63d2a14c9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a812da6-b9", "ovs_interfaceid": "1a812da6-b951-42d6-a9ef-d61fdb2f6ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG os_vif [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a812da6-b9, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:29 user nova-compute[71654]: INFO os_vif [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:b5:bf,bridge_name='br-int',has_traffic_filtering=True,id=1a812da6-b951-42d6-a9ef-d61fdb2f6ccd,network=Network(f8c05312-c164-4467-85c1-b6d6a33e43db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a812da6-b9')
Apr 11 20:41:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Deleting instance files /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1_del
Apr 11 20:41:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Deletion of /opt/stack/data/nova/instances/52b7250e-a85d-4c3f-93e7-ac05ebd13be1_del complete
Apr 11 20:41:29 user nova-compute[71654]: INFO nova.compute.manager [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 20:41:29 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:41:29 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:41:30 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:30 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Took 0.86 seconds to deallocate network for instance.
Apr 11 20:41:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:30 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:41:30 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:41:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:30 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Deleted allocations for instance 52b7250e-a85d-4c3f-93e7-ac05ebd13be1
Apr 11 20:41:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a18a071e-ad59-44a8-bb57-0a5da438de01 tempest-VolumesAdminNegativeTest-878898162 tempest-VolumesAdminNegativeTest-878898162-project-member] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Acquiring lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] Lock "52b7250e-a85d-4c3f-93e7-ac05ebd13be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] No waiting events found dispatching network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:31 user nova-compute[71654]: WARNING nova.compute.manager [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received unexpected event network-vif-plugged-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd for instance with vm_state deleted and task_state None.
Apr 11 20:41:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-6e8c0309-ec83-45f2-8694-b5dffbab40fc req-31681e72-9b39-4aec-a5f5-dae6d889c736 service nova] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Received event network-vif-deleted-1a812da6-b951-42d6-a9ef-d61fdb2f6ccd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 921fec20-d5dc-4387-b265-2d16a1c226f2 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid f1d5f91c-afaa-456a-97e7-0460b1748d79 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-changed-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing instance network info cache due to event network-changed-893b51e3-f5e5-41fa-aa56-913f6518dd5c. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:41:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Acquiring lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:41:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Acquired lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:41:40 user nova-compute[71654]: DEBUG nova.network.neutron [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Refreshing network info cache for port 893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:41:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updated VIF entry in instance network info cache for port 893b51e3-f5e5-41fa-aa56-913f6518dd5c. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:41:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [{"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b8617356-7ee9-4224-88e8-c801cf99a098 req-10a65190-c632-4c91-bdc6-3c7ae516750f service nova] Releasing lock "refresh_cache-921fec20-d5dc-4387-b265-2d16a1c226f2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:42 user nova-compute[71654]: INFO nova.compute.manager [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Terminating instance
Apr 11 20:41:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-73aa45a7-c3e1-4c16-9d9e-bbd08e73b643 req-a738b3eb-61ab-4d7c-bad8-5d8eb3d5d75d service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-7b21eb4e-2595-42b7-9b74-d225e141cce8 req-a41f95a8-5216-4fb2-ba11-9a8999b2deb2 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-4af039ce-a832-46f5-9c67-e57a075dec43 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-730e891d-ce3b-4d71-bd4b-c0deb302c85a req-8b9a4a05-2df1-4dcf-99fa-3f9ce55e1204 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-030dae9d-cc5b-4278-935b-b032bf6d29dd for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245689.5105596, 52b7250e-a85d-4c3f-93e7-ac05ebd13be1 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:41:44 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] VM Stopped (Lifecycle Event)
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d1dfddf5-9d43-422f-aecf-ab73d1dd55fa None None] [instance: 52b7250e-a85d-4c3f-93e7-ac05ebd13be1] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Instance destroyed successfully.
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lazy-loading 'resources' on Instance uuid 921fec20-d5dc-4387-b265-2d16a1c226f2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap893b51e3-f5, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:13:ec,bridge_name='br-int',has_traffic_filtering=True,id=893b51e3-f5e5-41fa-aa56-913f6518dd5c,network=Network(1c29d681-3612-460d-8aaa-35ae068f7ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893b51e3-f5')
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4af039ce-a8, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a7:1e,bridge_name='br-int',has_traffic_filtering=True,id=4af039ce-a832-46f5-9c67-e57a075dec43,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4af039ce-a8')
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa937413-1c, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:cb:84,bridge_name='br-int',has_traffic_filtering=True,id=fa937413-1cdc-4426-8707-25d48f79124c,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa937413-1c')
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c831b68-dc, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:58:51,bridge_name='br-int',has_traffic_filtering=True,id=6c831b68-dcd0-4ed9-8b7e-1b192ebd025a,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c831b68-dc')
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1380e6a6-40, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:32:dd,bridge_name='br-int',has_traffic_filtering=True,id=1380e6a6-4036-442f-8120-243f80c0e646,network=Network(c1513590-dd19-4e86-86a0-1e12264455ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380e6a6-40')
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc20d2e13-a7, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:1c,bridge_name='br-int',has_traffic_filtering=True,id=c20d2e13-a748-4cdd-9ba0-5350f331d56b,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc20d2e13-a7')
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T20:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-902658976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-902658976',id=12,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjCooPLjYfwUJGMnyokCA7HsZGyo8rSTzRX6QL/n0y4wjkOaGLHg1rrBBNlwUmqvGjTpSARe7d8/uDA9U3vj6CtkreNTszowyVZMtOf47x36r5oXQV8tu8e0aPnso62g==',key_name='tempest-keypair-1724644128',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d89f013fadbe411caf0a6f2856a11135',ramdisk_id='',reservation_id='r-nt5fzr0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280116242',owner_user_name='tempest-TaggedBootDevicesTest_v242-280116242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928391a137c94107af4dd426b9a086f7',uuid=921fec20-d5dc-4387-b265-2d16a1c226f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converting VIF {"id": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "address": "fa:16:3e:a1:22:41", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030dae9d-cc", "ovs_interfaceid": "030dae9d-cc5b-4278-935b-b032bf6d29dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap030dae9d-cc, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:44 user nova-compute[71654]: INFO os_vif [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:22:41,bridge_name='br-int',has_traffic_filtering=True,id=030dae9d-cc5b-4278-935b-b032bf6d29dd,network=Network(340d0912-d68e-427f-9ed9-e63555c56ad8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030dae9d-cc')
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIjskBQG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceb9221-4386-485a-a8ee-996a7df0c85f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]: iSNS:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]: STATIC:
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: FIRMWARE:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:41:45 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:41:45 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa548eb-0411-4946-8b62-f7ad58de51bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f42569-b94f-4d20-b34b-8778a8aeed49]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb3836dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c3695-873c-4bb7-9486-b1359105cf40]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027eeb1-d3a5-4421-a9e3-b1f475537822]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b7fc3-ba0b-422f-a090-d1565f2789a6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd07565-01aa-4216-860c-ec5c0c8ae464]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[13048183-a473-438d-82f0-ef1506460e70]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-893b51e3-f5e5-41fa-aa56-913f6518dd5c for instance with vm_state active and task_state deleting.
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING nova.compute.manager [req-99b802df-26b2-41ce-bdc9-d665f88262c7 req-9ffa96e6-f66d-4392-9b98-e19efea8e04a service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-c20d2e13-a748-4cdd-9ba0-5350f331d56b for instance with vm_state active and task_state deleting.
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[889a9f0d-52b1-4858-aab9-bae4b81dd58d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260]
Apr 11 20:41:45 user nova-compute[71654]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b80e2a1-e119-4c40-97c9-7d393ddf700c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[29043467-555e-4e21-861d-41731dbd4ca2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== disconnect_volume: return (314ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgUhjnXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9839b81-799a-41a3-b422-793f9f761bf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]: iSNS:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]: STATIC:
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: FIRMWARE:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:41:45 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:41:45 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[873befb6-be24-4526-a7af-eed915058f29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16939f69-c538-4275-9393-31fc351cd8e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb38397010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59'): ({'sdg'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Removing single pathed devices sdg {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-4af039ce-a832-46f5-9c67-e57a075dec43 for instance with vm_state active and task_state deleting.
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-fa937413-1cdc-4426-8707-25d48f79124c for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-fa937413-1cdc-4426-8707-25d48f79124c for instance with vm_state active and task_state deleting.
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a for instance with vm_state active and task_state deleting.
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-unplugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-unplugged-1380e6a6-4036-442f-8120-243f80c0e646 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING nova.compute.manager [req-25016768-cb94-4051-af65-3c1a886561b6 req-3b5c1441-31eb-4138-b164-3120525d9798 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-1380e6a6-4036-442f-8120-243f80c0e646 for instance with vm_state active and task_state deleting.
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42da4c7-fc62-4dfc-abc0-05b7f203def8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54adcf5-99b3-4a87-9b20-d03f355d1ff6]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flushing IO for device /dev/sdg {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab92566c-465a-42f9-a958-a7ae82e9f55a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba428879-a9dc-4f4d-a066-7482a9ee9779]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] SCSI volumes sdg have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f8165-37a0-4b58-ae62-53e2e4e4db3e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c954f4-1d9c-47ab-a937-fcb292a6bb45]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260]
Apr 11 20:41:45 user nova-compute[71654]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e8c94c-6902-4769-9266-b990c406ce59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8894f-1138-4e1e-a3b9-121c741360ae]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== disconnect_volume: return (313ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxkQPVhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:45 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[92030d0a-ee3b-48eb-b4b1-38d9c719bca1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]: iSNS:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]: STATIC:
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d
Apr 11 20:41:45 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:45 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:45 user nova-compute[71654]: FIRMWARE:
Apr 11 20:41:45 user nova-compute[71654]: No targets found.
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:41:45 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:41:45 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1aeb0e-632f-4d8a-ba52-56b1c1de4dbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d79986-ff61-4ede-985f-e08455fd8cdb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d (non-flash)
Apr 11 20:41:45 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb383968c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d'): ({'sdf'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Removing single pathed devices sdf {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccdaaec-dc5d-4678-835c-32f3b09f27ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8303686-bf79-4c4c-b45d-d4054e203f81]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Flushing IO for device /dev/sdf {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2641666-2674-4f36-9d50-1d88f2b5a2f2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a5f627-0069-421c-a9a7-70261ba5bef5]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2425b-e18d-4e14-9f77-fdaf9d5790d0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[406a239f-7189-4685-b927-663a765f5abf]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260]
Apr 11 20:41:45 user nova-compute[71654]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fb7e91a-38b6-4ad8-81b6-529dca4a5c0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e6408a-c70c-467e-99c2-321feb03e19c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] <== disconnect_volume: return (299ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:41:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Deleting instance files /opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2_del
Apr 11 20:41:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Deletion of /opt/stack/data/nova/instances/921fec20-d5dc-4387-b265-2d16a1c226f2_del complete
Apr 11 20:41:46 user nova-compute[71654]: INFO nova.compute.manager [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Took 3.18 seconds to destroy the instance on the hypervisor.
Apr 11 20:41:46 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Acquiring lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] No waiting events found dispatching network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:46 user nova-compute[71654]: WARNING nova.compute.manager [req-8d601cf9-9104-49b3-8a69-8f5c1a31afb6 req-3691efde-3ec8-40d3-80dd-5482e6e284a5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received unexpected event network-vif-plugged-030dae9d-cc5b-4278-935b-b032bf6d29dd for instance with vm_state active and task_state deleting.
Apr 11 20:41:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-deleted-030dae9d-cc5b-4278-935b-b032bf6d29dd {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:47 user nova-compute[71654]: INFO nova.compute.manager [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Neutron deleted interface 030dae9d-cc5b-4278-935b-b032bf6d29dd; detaching it from the instance and deleting it from the info cache
Apr 11 20:41:47 user nova-compute[71654]: DEBUG nova.network.neutron [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [{"id": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "address": "fa:16:3e:ec:13:ec", "network": {"id": "1c29d681-3612-460d-8aaa-35ae068f7ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-221813884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893b51e3-f5", "ovs_interfaceid": "893b51e3-f5e5-41fa-aa56-913f6518dd5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4af039ce-a832-46f5-9c67-e57a075dec43", "address": "fa:16:3e:26:a7:1e", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4af039ce-a8", "ovs_interfaceid": "4af039ce-a832-46f5-9c67-e57a075dec43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa937413-1cdc-4426-8707-25d48f79124c", "address": "fa:16:3e:ff:cb:84", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa937413-1c", "ovs_interfaceid": "fa937413-1cdc-4426-8707-25d48f79124c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "address": "fa:16:3e:94:58:51", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c831b68-dc", "ovs_interfaceid": "6c831b68-dcd0-4ed9-8b7e-1b192ebd025a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1380e6a6-4036-442f-8120-243f80c0e646", "address": "fa:16:3e:4f:32:dd", "network": {"id": "c1513590-dd19-4e86-86a0-1e12264455ec", "bridge": "br-int", "label": "tempest-device-tagging-net1-142421425", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380e6a6-40", "ovs_interfaceid": "1380e6a6-4036-442f-8120-243f80c0e646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "address": "fa:16:3e:99:d3:1c", "network": {"id": "340d0912-d68e-427f-9ed9-e63555c56ad8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2036029110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d89f013fadbe411caf0a6f2856a11135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc20d2e13-a7", "ovs_interfaceid": "c20d2e13-a748-4cdd-9ba0-5350f331d56b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-277d8616-363b-4360-981d-899c18fc1f51 req-80f1da8e-06fd-4de1-9c82-242429ed3ba5 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Detach interface failed, port_id=030dae9d-cc5b-4278-935b-b032bf6d29dd, reason: Instance 921fec20-d5dc-4387-b265-2d16a1c226f2 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:41:49 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:49 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Took 3.62 seconds to deallocate network for instance.
Apr 11 20:41:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-deleted-c20d2e13-a748-4cdd-9ba0-5350f331d56b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-deleted-893b51e3-f5e5-41fa-aa56-913f6518dd5c {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-deleted-6c831b68-dcd0-4ed9-8b7e-1b192ebd025a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-9089dd40-7a52-4f04-8276-d0f4c535b5a3 req-1c130411-ffd9-4eda-bd03-a5e586d18024 service nova] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Received event network-vif-deleted-1380e6a6-4036-442f-8120-243f80c0e646 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:51 user nova-compute[71654]: INFO nova.compute.manager [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Took 2.33 seconds to detach 3 volumes for instance.
Apr 11 20:41:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:52 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Deleted allocations for instance 921fec20-d5dc-4387-b265-2d16a1c226f2
Apr 11 20:41:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-103f4812-926b-4d4a-a16d-ab59e114c6f3 tempest-TaggedBootDevicesTest_v242-280116242 tempest-TaggedBootDevicesTest_v242-280116242-project-member] Lock "921fec20-d5dc-4387-b265-2d16a1c226f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.572s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:52 user nova-compute[71654]: INFO nova.compute.manager [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Detaching volume 7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:52 user nova-compute[71654]: INFO nova.virt.block_device [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Attempting to driver detach volume 7b9f6713-befd-4589-bd9a-3defae1c71e7 from mountpoint /dev/vdb
Apr 11 20:41:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Attempting to detach device vdb from instance fe5fb157-6ca9-4e9f-87c6-11300909fdca from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:41:52 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:41:52 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:41:52 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:41:52 user nova-compute[71654]:   <serial>7b9f6713-befd-4589-bd9a-3defae1c71e7</serial>
Apr 11 20:41:52 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:41:52 user nova-compute[71654]: </disk>
Apr 11 20:41:52 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:41:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Successfully detached device vdb from instance fe5fb157-6ca9-4e9f-87c6-11300909fdca from the persistent domain config.
Apr 11 20:41:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe5fb157-6ca9-4e9f-87c6-11300909fdca from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:41:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:41:52 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:41:52 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:41:52 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:41:52 user nova-compute[71654]:   <serial>7b9f6713-befd-4589-bd9a-3defae1c71e7</serial>
Apr 11 20:41:52 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:41:52 user nova-compute[71654]: </disk>
Apr 11 20:41:52 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245713.0511372, fe5fb157-6ca9-4e9f-87c6-11300909fdca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:41:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Successfully detached device vdb from instance fe5fb157-6ca9-4e9f-87c6-11300909fdca from the live domain config.
Apr 11 20:41:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GlbTwYaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:41:53 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c610adb-1035-470d-bff8-a908ddca5690]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:41:53 user nova-compute[71654]: No targets found.
Apr 11 20:41:53 user nova-compute[71654]: iSNS:
Apr 11 20:41:53 user nova-compute[71654]: No targets found.
Apr 11 20:41:53 user nova-compute[71654]: STATIC:
Apr 11 20:41:53 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:41:53 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:53 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:53 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:41:53 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:53 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:53 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7
Apr 11 20:41:53 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:41:53 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:41:53 user nova-compute[71654]: FIRMWARE:
Apr 11 20:41:53 user nova-compute[71654]: No targets found.
Apr 11 20:41:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:41:53 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:41:53 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c071e-5286-4bc6-b630-69e7e25cf4a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[19abeab5-472c-4595-8c62-79a0d832b550]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:53 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:53 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 (non-flash)
Apr 11 20:41:53 user nova-compute[71654]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:41:53 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:41:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb3834c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0beb8c-6ebe-4387-93de-a765ff2eee20]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51dc99-3db6-4dab-bc58-2723bc678b71]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba174ef4-9691-4a01-a33c-b8e00e7a1e19]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b578bf-df82-4a07-862b-f9e8e74f3796]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff38d8-9b7a-4822-b12c-3c6b593bf3cb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fabe430-7ee3-4ee2-a0b7-948ad87a7c08]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260]
Apr 11 20:41:53 user nova-compute[71654]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7, portal: 172.16.0.220,3260] successful.
Apr 11 20:41:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b9f6713-befd-4589-bd9a-3defae1c71e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b724e14b-afef-4ec3-84e9-edffad85b73d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] <== disconnect_volume: return (295ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:41:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG nova.objects.instance [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'flavor' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f7a2ddbc-7715-4723-aa69-ffb4e580f89a tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:54 user nova-compute[71654]: INFO nova.compute.manager [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Terminating instance
Apr 11 20:41:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-unplugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-unplugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-64fe851f-87f0-4586-a64e-335ee82f2fe6 req-a41d7943-328a-43f6-b3f2-7cb7b3983904 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-unplugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:41:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:54 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Instance destroyed successfully.
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'resources' on Instance uuid 534b82fe-0c07-46dd-bb21-66ad7f6b1397 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1482156858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1482156858',id=2,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR9qqL3LAGODqH+Z+1EkQCpgM8apAvzyB/jSy1MSWBRkUN4MsKV/vwwKd/cnP2giBycseEQJi5Z0VeYGnUBpd0fbzhscsD5KYv7mXFpxsVb4OZ8zQ+33MPkGmZFDcxTSg==',key_name='tempest-keypair-1950690295',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-y79rwl52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=534b82fe-0c07-46dd-bb21-66ad7f6b1397,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "address": "fa:16:3e:d1:0b:a8", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d4c99b-9f", "ovs_interfaceid": "d2d4c99b-9fd2-4090-9c8a-072b6625a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG os_vif [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2d4c99b-9f, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:41:55 user nova-compute[71654]: INFO os_vif [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0b:a8,bridge_name='br-int',has_traffic_filtering=True,id=d2d4c99b-9fd2-4090-9c8a-072b6625a081,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d4c99b-9f')
Apr 11 20:41:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Deleting instance files /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397_del
Apr 11 20:41:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Deletion of /opt/stack/data/nova/instances/534b82fe-0c07-46dd-bb21-66ad7f6b1397_del complete
Apr 11 20:41:55 user nova-compute[71654]: INFO nova.compute.manager [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 20:41:55 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:41:55 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Took 0.67 seconds to deallocate network for instance.
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-4d512ce1-4eab-4370-9d28-e827bc5bfd01 req-8b7e6848-79e0-4042-902a-4c15456aaaf9 service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-deleted-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:55 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:56 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Deleted allocations for instance 534b82fe-0c07-46dd-bb21-66ad7f6b1397
Apr 11 20:41:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52d4566c-7929-4510-9a1f-b56ac7e1227e tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Acquiring lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] Lock "534b82fe-0c07-46dd-bb21-66ad7f6b1397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:41:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] No waiting events found dispatching network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:41:56 user nova-compute[71654]: WARNING nova.compute.manager [req-9c8d43c8-dc38-4e0a-b8e8-3f3dcd355a20 req-5b4ed036-6ec2-43d7-99df-d25e07d6e3bc service nova] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Received unexpected event network-vif-plugged-d2d4c99b-9fd2-4090-9c8a-072b6625a081 for instance with vm_state deleted and task_state None.
Apr 11 20:41:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:41:59 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245704.6620553, 921fec20-d5dc-4387-b265-2d16a1c226f2 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:41:59 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] VM Stopped (Lifecycle Event)
Apr 11 20:41:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-f02ef1d4-0bfb-4ed7-88d9-bc4f1a368a09 None None] [instance: 921fec20-d5dc-4387-b265-2d16a1c226f2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:02 user nova-compute[71654]: INFO nova.compute.manager [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] instance snapshotting
Apr 11 20:42:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Beginning live snapshot process
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.129s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgpehz8ld/3a9ba2913832410994c1c678ac5985cc.delta 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgpehz8ld/3a9ba2913832410994c1c678ac5985cc.delta 1073741824" returned: 0 in 0.048s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 20:42:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:42:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:42:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 20:42:04 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:42:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgpehz8ld/3a9ba2913832410994c1c678ac5985cc.delta /opt/stack/data/nova/instances/snapshots/tmpgpehz8ld/3a9ba2913832410994c1c678ac5985cc {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgpehz8ld/3a9ba2913832410994c1c678ac5985cc.delta /opt/stack/data/nova/instances/snapshots/tmpgpehz8ld/3a9ba2913832410994c1c678ac5985cc" returned: 0 in 0.331s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Snapshot extracted, beginning image upload
Apr 11 20:42:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Snapshot image upload complete
Apr 11 20:42:07 user nova-compute[71654]: INFO nova.compute.manager [None req-d5a02f68-2eef-46a0-bfb8-70d651f9e175 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Took 4.47 seconds to snapshot the instance on the hypervisor.
Apr 11 20:42:09 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245714.9960237, 534b82fe-0c07-46dd-bb21-66ad7f6b1397 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:42:09 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] VM Stopped (Lifecycle Event)
Apr 11 20:42:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2edea04a-51d8-4a14-ae1f-02f2976bb465 None None] [instance: 534b82fe-0c07-46dd-bb21-66ad7f6b1397] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG nova.compute.manager [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-changed-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG nova.compute.manager [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Refreshing instance network info cache due to event network-changed-087e4499-cfde-448a-b093-08f4b879f946. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Refreshing network info cache for port 087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updated VIF entry in instance network info cache for port 087e4499-cfde-448a-b093-08f4b879f946. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a8ddd504-0e6b-4cef-bfdc-cefd3b26e47c req-1d59afe1-f797-4483-bff2-7d1da5c5b201 service nova] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:42:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:12 user nova-compute[71654]: INFO nova.compute.manager [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Attaching volume 042389e0-da53-4582-ae52-c57ba7f3c396 to /dev/vdb
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d31b40-a13c-4dfb-96f7-863816b358c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03b2e1-4022-4026-8acf-3630d8a61532]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d137e22a-2e57-42da-8263-6967d7904009]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e4bd6-977e-43bf-b733-f0832d98122d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:42:13 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5965ea83-1bbb-4fb0-90c4-52092c5bd98f]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.utils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating existing volume attachment record: c9f23a9e-9503-42d6-b4d7-5e2de7d094f5 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:13 user nova-compute[71654]: INFO nova.compute.manager [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Detaching volume 9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:42:13 user nova-compute[71654]: INFO nova.virt.block_device [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attempting to driver detach volume 9482e06e-2cf5-4af8-b281-e43941df6b7c from mountpoint /dev/vdb
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Attempting to detach device vdb from instance dadac585-3a7c-40d8-a335-fc2603588c28 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:42:13 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:42:13 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:42:13 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:42:13 user nova-compute[71654]:   <serial>9482e06e-2cf5-4af8-b281-e43941df6b7c</serial>
Apr 11 20:42:13 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:42:13 user nova-compute[71654]: </disk>
Apr 11 20:42:13 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:42:13 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully detached device vdb from instance dadac585-3a7c-40d8-a335-fc2603588c28 from the persistent domain config.
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dadac585-3a7c-40d8-a335-fc2603588c28 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:42:13 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:42:13 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:42:13 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:42:13 user nova-compute[71654]:   <serial>9482e06e-2cf5-4af8-b281-e43941df6b7c</serial>
Apr 11 20:42:13 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:42:13 user nova-compute[71654]: </disk>
Apr 11 20:42:13 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245733.7713172, dadac585-3a7c-40d8-a335-fc2603588c28 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:42:13 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully detached device vdb from instance dadac585-3a7c-40d8-a335-fc2603588c28 from the live domain config.
Apr 11 20:42:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nusiAVMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:42:13 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef8898a-e3aa-4998-9c2e-0d7239e7464b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:42:13 user nova-compute[71654]: No targets found.
Apr 11 20:42:13 user nova-compute[71654]: iSNS:
Apr 11 20:42:13 user nova-compute[71654]: No targets found.
Apr 11 20:42:13 user nova-compute[71654]: STATIC:
Apr 11 20:42:13 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:42:13 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:42:13 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:42:13 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c
Apr 11 20:42:13 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:42:13 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:42:13 user nova-compute[71654]: FIRMWARE:
Apr 11 20:42:13 user nova-compute[71654]: No targets found.
Apr 11 20:42:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:42:13 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:42:13 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa7881c-b619-4fc8-83d4-bbcc4e64c95d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6bd075-5aae-49e5-a07c-bebfb9d0a4b1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:42:13 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:42:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c (non-flash)
Apr 11 20:42:13 user nova-compute[71654]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:42:13 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb4189f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[748196d5-e68a-47b2-81f7-64a8b91e3c5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37eeb7-259f-43c9-a56e-3af3988646ee]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133297c-cf09-4892-a5d7-42339dfd2641]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e7609-98ea-40d4-90bc-8d784d49204b]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[625cf458-8535-462c-ad03-5729c2c2475d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb62ae5-c278-4381-9515-0bedc118aa4d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260]
Apr 11 20:42:14 user nova-compute[71654]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c, portal: 172.16.0.220,3260] successful.
Apr 11 20:42:14 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9482e06e-2cf5-4af8-b281-e43941df6b7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a01eb-aecc-48f0-ba5e-0a70a78659eb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (302ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'flavor' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e4ec5abc-d2fa-436b-af3d-ab7bc8552a4b tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:14 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:42:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:42:17 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:42:17 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:42:17 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9662c843-04b0-4735-9746-85d03ead4910]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:42:17 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[83009801-e730-4072-afb4-6be5c979003f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396] added
Apr 11 20:42:17 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[12765a71-ac09-44b2-a684-2472c5cb69ac]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb40af-dc53-4ac9-80ac-4d690b53b0ca]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiKRfdeV {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiKRfdeV" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d860db-6ac5-4ee0-8f28-574134d97699]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZiKRfdeV'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6b7ae-bd73-4f85-92dd-49a0e090944e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[84729ef8-ee3c-4ea8-b486-975bebfe66d8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:42:17 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:42:17 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b4201b-e9e3-41c6-abd9-1994c2ae11e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]
Apr 11 20:42:17 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.
Apr 11 20:42:17 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4f960-8b49-4626-be72-5f7d8c9c971d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e53f5dd-44d0-4a8d-80f7-085b6630ff27]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:42:17 user nova-compute[71654]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:42:17 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:42:17 user nova-compute[71654]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:42:17 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b22b3-f810-4e00-93ce-797f9897eed6]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:42:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26131393434623033', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131393434623033', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:42:18 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:42:18 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:42:18 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:42:18 user nova-compute[71654]:   <serial>042389e0-da53-4582-ae52-c57ba7f3c396</serial>
Apr 11 20:42:18 user nova-compute[71654]: </disk>
Apr 11 20:42:18 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No VIF found with MAC fa:16:3e:1a:3b:8b, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:19 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:42:19 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8157MB free_disk=26.469810485839844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7c071352-18aa-4734-a514-8922fff5c9b1 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.576s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71654) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance fe5fb157-6ca9-4e9f-87c6-11300909fdca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 6af82381-69fc-47e5-a16f-cea88c569240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:19 user nova-compute[71654]: WARNING nova.compute.manager [req-14eba241-9917-484a-80cc-fe9500d63b89 req-842e9d0e-0378-4886-a443-5f9f2bdb81c6 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state active and task_state powering-off.
Apr 11 20:42:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance destroyed successfully.
Apr 11 20:42:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-604dc0ec-f2a7-41fb-b8f7-fa067c274bb3 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.865s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:21 user nova-compute[71654]: WARNING nova.compute.manager [req-40ca23bc-3b7d-468b-baf5-b4e99a80a316 req-d879226a-6dde-4003-a9f3-72366a0c1dff service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state stopped and task_state None.
Apr 11 20:42:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:35 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245740.4079978, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:42:35 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Stopped (Lifecycle Event)
Apr 11 20:42:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bfb1cdbf-7c40-4817-a682-a2c5d7655627 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bfb1cdbf-7c40-4817-a682-a2c5d7655627 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:42:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:42:38 user nova-compute[71654]: INFO nova.compute.claims [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Claim successful on node user
Apr 11 20:42:38 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:42:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.policy [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:42:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Creating image(s)
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "/opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk 1073741824" returned: 0 in 0.048s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Cannot resize image /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'migration_context' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Ensure instance console log exists: /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Successfully created port: 7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Successfully updated port: 7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquired lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-changed-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Refreshing instance network info cache due to event network-changed-7e936873-bcfe-497e-b850-374d6ae930a6. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Acquiring lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:42:40 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updating instance_info_cache with network_info: [{"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Releasing lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Instance network_info: |[{"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Acquired lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Refreshing network info cache for port 7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Start _get_guest_xml network_info=[{"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:42:41 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:42:41 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-197605793',display_name='tempest-AttachVolumeNegativeTest-server-197605793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-197605793',id=15,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEd9qv94tRkT45FuNHkmLkkpIBVswbIY16UkibPoyN1X5rD6j733moSAHr5g2t/t4SlwcLf7Ob21UpIrp1iW3TfXNOEKKmcMWCuF6+soRAAJS05EI3VRMpEWmnJ6ZTAqQ==',key_name='tempest-keypair-668966515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-pzh042r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=645e96f7-547e-4eea-8523-7f7918c0ad3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'pci_devices' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:42:41 user nova-compute[71654]:   <uuid>645e96f7-547e-4eea-8523-7f7918c0ad3e</uuid>
Apr 11 20:42:41 user nova-compute[71654]:   <name>instance-0000000f</name>
Apr 11 20:42:41 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:42:41 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:42:41 user nova-compute[71654]:   <metadata>
Apr 11 20:42:41 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:42:41 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:42:41 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeNegativeTest-server-197605793</nova:name>
Apr 11 20:42:41 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:42:41</nova:creationTime>
Apr 11 20:42:41 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:42:41 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:42:41 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:42:41 user nova-compute[71654]:       <nova:owner>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:user uuid="4f69b01612974865be4e1e1b6a9bd570">tempest-AttachVolumeNegativeTest-1901377641-project-member</nova:user>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:project uuid="db28134878ba46528b7d5012ff9c7aff">tempest-AttachVolumeNegativeTest-1901377641</nova:project>
Apr 11 20:42:41 user nova-compute[71654]:       </nova:owner>
Apr 11 20:42:41 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:42:41 user nova-compute[71654]:       <nova:ports>
Apr 11 20:42:41 user nova-compute[71654]:         <nova:port uuid="7e936873-bcfe-497e-b850-374d6ae930a6">
Apr 11 20:42:41 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 20:42:41 user nova-compute[71654]:         </nova:port>
Apr 11 20:42:41 user nova-compute[71654]:       </nova:ports>
Apr 11 20:42:41 user nova-compute[71654]:     </nova:instance>
Apr 11 20:42:41 user nova-compute[71654]:   </metadata>
Apr 11 20:42:41 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:42:41 user nova-compute[71654]:     <system>
Apr 11 20:42:41 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:42:41 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:42:41 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:42:41 user nova-compute[71654]:       <entry name="serial">645e96f7-547e-4eea-8523-7f7918c0ad3e</entry>
Apr 11 20:42:41 user nova-compute[71654]:       <entry name="uuid">645e96f7-547e-4eea-8523-7f7918c0ad3e</entry>
Apr 11 20:42:41 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:42:41 user nova-compute[71654]:     </system>
Apr 11 20:42:41 user nova-compute[71654]:   </sysinfo>
Apr 11 20:42:41 user nova-compute[71654]:   <os>
Apr 11 20:42:41 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:42:41 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:42:41 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:42:41 user nova-compute[71654]:   </os>
Apr 11 20:42:41 user nova-compute[71654]:   <features>
Apr 11 20:42:41 user nova-compute[71654]:     <acpi/>
Apr 11 20:42:41 user nova-compute[71654]:     <apic/>
Apr 11 20:42:41 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:42:41 user nova-compute[71654]:   </features>
Apr 11 20:42:41 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:42:41 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:42:41 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:42:41 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:42:41 user nova-compute[71654]:   </clock>
Apr 11 20:42:41 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:42:41 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:42:41 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:42:41 user nova-compute[71654]:   </cpu>
Apr 11 20:42:41 user nova-compute[71654]:   <devices>
Apr 11 20:42:41 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:42:41 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:42:41 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk"/>
Apr 11 20:42:41 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:42:41 user nova-compute[71654]:     </disk>
Apr 11 20:42:41 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:42:41 user nova-compute[71654]:       <mac address="fa:16:3e:6e:74:f1"/>
Apr 11 20:42:41 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:42:41 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:42:41 user nova-compute[71654]:       <target dev="tap7e936873-bc"/>
Apr 11 20:42:41 user nova-compute[71654]:     </interface>
Apr 11 20:42:41 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:42:41 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/console.log" append="off"/>
Apr 11 20:42:41 user nova-compute[71654]:     </serial>
Apr 11 20:42:41 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:42:41 user nova-compute[71654]:     <video>
Apr 11 20:42:41 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:42:41 user nova-compute[71654]:     </video>
Apr 11 20:42:41 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:42:41 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:42:41 user nova-compute[71654]:     </rng>
Apr 11 20:42:41 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:42:41 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:42:41 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:42:41 user nova-compute[71654]:     </memballoon>
Apr 11 20:42:41 user nova-compute[71654]:   </devices>
Apr 11 20:42:41 user nova-compute[71654]: </domain>
Apr 11 20:42:41 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-197605793',display_name='tempest-AttachVolumeNegativeTest-server-197605793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-197605793',id=15,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEd9qv94tRkT45FuNHkmLkkpIBVswbIY16UkibPoyN1X5rD6j733moSAHr5g2t/t4SlwcLf7Ob21UpIrp1iW3TfXNOEKKmcMWCuF6+soRAAJS05EI3VRMpEWmnJ6ZTAqQ==',key_name='tempest-keypair-668966515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-pzh042r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=645e96f7-547e-4eea-8523-7f7918c0ad3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG os_vif [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e936873-bc, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e936873-bc, col_values=(('external_ids', {'iface-id': '7e936873-bcfe-497e-b850-374d6ae930a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:74:f1', 'vm-uuid': '645e96f7-547e-4eea-8523-7f7918c0ad3e'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:41 user nova-compute[71654]: INFO os_vif [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc')
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:6e:74:f1, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updated VIF entry in instance network info cache for port 7e936873-bcfe-497e-b850-374d6ae930a6. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updating instance_info_cache with network_info: [{"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69f8baeb-2b69-44ca-9054-2c9094a6333c req-a5dde92b-47c7-4269-96c7-b1aaaa5cf412 service nova] Releasing lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] No waiting events found dispatching network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:42 user nova-compute[71654]: WARNING nova.compute.manager [req-fec2916f-2926-486e-8b30-d6247e101cf4 req-c29d2696-adae-4021-858a-6d59391cffa3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received unexpected event network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 for instance with vm_state building and task_state spawning.
Apr 11 20:42:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.compute.manager [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Terminating instance
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245764.8050277, 645e96f7-547e-4eea-8523-7f7918c0ad3e => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] VM Resumed (Lifecycle Event)
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Instance spawned successfully.
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245764.8070278, 645e96f7-547e-4eea-8523-7f7918c0ad3e => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] VM Started (Lifecycle Event)
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Took 5.72 seconds to spawn the instance on the hypervisor.
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:44 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] No waiting events found dispatching network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:44 user nova-compute[71654]: WARNING nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received unexpected event network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 for instance with vm_state building and task_state spawning.
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-unplugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Acquiring lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] No waiting events found dispatching network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:44 user nova-compute[71654]: WARNING nova.compute.manager [req-5438ae55-6774-436a-a2df-fc3bb5debd0f req-fb1e2860-2ab5-4212-b150-a1e91a718103 service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received unexpected event network-vif-plugged-1ef9bc31-64d9-48ac-b54c-80d0b4487897 for instance with vm_state active and task_state deleting.
Apr 11 20:42:45 user nova-compute[71654]: INFO nova.compute.manager [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Took 6.41 seconds to build instance.
Apr 11 20:42:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e3d7c40e-9752-4f68-8e4e-a675dac040a9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.516s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Instance destroyed successfully.
Apr 11 20:42:45 user nova-compute[71654]: DEBUG nova.objects.instance [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lazy-loading 'resources' on Instance uuid fe5fb157-6ca9-4e9f-87c6-11300909fdca {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1743051561',display_name='tempest-ServerStableDeviceRescueTest-server-1743051561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1743051561',id=4,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8edukNlRzRt2xM1Yz79RSQhOkxsm8ccsONALiSEdR71l6YiK0hGivRdMEIPe6FhH/dBsOBuEPFT6mch0ytfQkkG8lca42/DiYBmO2hVEc7hq5brWI1oZCdGBeI4245iw==',key_name='tempest-keypair-2032053389',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8329ebeb037462d864dd5cf8aefc6b8',ramdisk_id='',reservation_id='r-nn7gj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-435801344',owner_user_name='tempest-ServerStableDeviceRescueTest-435801344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='127b201d67de4bacaed034d4becdc955',uuid=fe5fb157-6ca9-4e9f-87c6-11300909fdca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converting VIF {"id": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "address": "fa:16:3e:7c:29:9c", "network": {"id": "ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-521790838-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8329ebeb037462d864dd5cf8aefc6b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef9bc31-64", "ovs_interfaceid": "1ef9bc31-64d9-48ac-b54c-80d0b4487897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG os_vif [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ef9bc31-64, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:45 user nova-compute[71654]: INFO os_vif [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:29:9c,bridge_name='br-int',has_traffic_filtering=True,id=1ef9bc31-64d9-48ac-b54c-80d0b4487897,network=Network(ca9625e4-8b9f-4d8f-b6b5-6abe2a1346d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef9bc31-64')
Apr 11 20:42:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Deleting instance files /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca_del
Apr 11 20:42:45 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Deletion of /opt/stack/data/nova/instances/fe5fb157-6ca9-4e9f-87c6-11300909fdca_del complete
Apr 11 20:42:45 user nova-compute[71654]: INFO nova.compute.manager [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 20:42:45 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:42:45 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:42:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:46 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Took 1.00 seconds to deallocate network for instance.
Apr 11 20:42:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-df62e3df-35eb-4325-9010-e7958fe6bf5e req-88abe80d-3380-4f99-9381-72ba7f73717f service nova] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Received event network-vif-deleted-1ef9bc31-64d9-48ac-b54c-80d0b4487897 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:46 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:42:46 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:42:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.641s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:47 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Deleted allocations for instance fe5fb157-6ca9-4e9f-87c6-11300909fdca
Apr 11 20:42:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-64681c67-e72a-498f-983f-49bb20eee741 tempest-ServerStableDeviceRescueTest-435801344 tempest-ServerStableDeviceRescueTest-435801344-project-member] Lock "fe5fb157-6ca9-4e9f-87c6-11300909fdca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:42:49 user nova-compute[71654]: INFO nova.compute.claims [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Claim successful on node user
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:42:49 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.policy [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f82468d207064eb288a2c8a167cd7d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5fce55f8224068805593f94d5f2d36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:42:49 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Creating image(s)
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk 1073741824" returned: 0 in 0.051s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Cannot resize image /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'migration_context' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Ensure instance console log exists: /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Successfully created port: 70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Successfully updated port: 70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing instance network info cache due to event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance network_info: |[{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Start _get_guest_xml network_info=[{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:42:51 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:42:51 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345208448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345208448',id=16,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXzG/+iyFuLq/UP2Nf5869PwPaIxZUHlcTfcaQgIRL9ghHbGCVYa9ZHifqpcdGOoDPU/AR9Vn/W3qYR1rkx0sBJJpcHf1bVwdR/Ko66Ttz3Mo82/6YMPmg7BC5ao/FyXQ==',key_name='tempest-keypair-545600492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-voquowxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=4ad985d5-6fd0-48f3-be8f-00a7fc4791c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:42:51 user nova-compute[71654]:   <uuid>4ad985d5-6fd0-48f3-be8f-00a7fc4791c4</uuid>
Apr 11 20:42:51 user nova-compute[71654]:   <name>instance-00000010</name>
Apr 11 20:42:51 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:42:51 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:42:51 user nova-compute[71654]:   <metadata>
Apr 11 20:42:51 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:42:51 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:42:51 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-345208448</nova:name>
Apr 11 20:42:51 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:42:51</nova:creationTime>
Apr 11 20:42:51 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:42:51 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:42:51 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:42:51 user nova-compute[71654]:       <nova:owner>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:user uuid="f82468d207064eb288a2c8a167cd7d9d">tempest-AttachVolumeShelveTestJSON-426216861-project-member</nova:user>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:project uuid="0d5fce55f8224068805593f94d5f2d36">tempest-AttachVolumeShelveTestJSON-426216861</nova:project>
Apr 11 20:42:51 user nova-compute[71654]:       </nova:owner>
Apr 11 20:42:51 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:42:51 user nova-compute[71654]:       <nova:ports>
Apr 11 20:42:51 user nova-compute[71654]:         <nova:port uuid="70b946a4-0951-4e8c-adc6-ac21f5837691">
Apr 11 20:42:51 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:42:51 user nova-compute[71654]:         </nova:port>
Apr 11 20:42:51 user nova-compute[71654]:       </nova:ports>
Apr 11 20:42:51 user nova-compute[71654]:     </nova:instance>
Apr 11 20:42:51 user nova-compute[71654]:   </metadata>
Apr 11 20:42:51 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:42:51 user nova-compute[71654]:     <system>
Apr 11 20:42:51 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:42:51 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:42:51 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:42:51 user nova-compute[71654]:       <entry name="serial">4ad985d5-6fd0-48f3-be8f-00a7fc4791c4</entry>
Apr 11 20:42:51 user nova-compute[71654]:       <entry name="uuid">4ad985d5-6fd0-48f3-be8f-00a7fc4791c4</entry>
Apr 11 20:42:51 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:42:51 user nova-compute[71654]:     </system>
Apr 11 20:42:51 user nova-compute[71654]:   </sysinfo>
Apr 11 20:42:51 user nova-compute[71654]:   <os>
Apr 11 20:42:51 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:42:51 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:42:51 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:42:51 user nova-compute[71654]:   </os>
Apr 11 20:42:51 user nova-compute[71654]:   <features>
Apr 11 20:42:51 user nova-compute[71654]:     <acpi/>
Apr 11 20:42:51 user nova-compute[71654]:     <apic/>
Apr 11 20:42:51 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:42:51 user nova-compute[71654]:   </features>
Apr 11 20:42:51 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:42:51 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:42:51 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:42:51 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:42:51 user nova-compute[71654]:   </clock>
Apr 11 20:42:51 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:42:51 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:42:51 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:42:51 user nova-compute[71654]:   </cpu>
Apr 11 20:42:51 user nova-compute[71654]:   <devices>
Apr 11 20:42:51 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:42:51 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:42:51 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk"/>
Apr 11 20:42:51 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:42:51 user nova-compute[71654]:     </disk>
Apr 11 20:42:51 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:42:51 user nova-compute[71654]:       <mac address="fa:16:3e:ef:c2:2c"/>
Apr 11 20:42:51 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:42:51 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:42:51 user nova-compute[71654]:       <target dev="tap70b946a4-09"/>
Apr 11 20:42:51 user nova-compute[71654]:     </interface>
Apr 11 20:42:51 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:42:51 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/console.log" append="off"/>
Apr 11 20:42:51 user nova-compute[71654]:     </serial>
Apr 11 20:42:51 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:42:51 user nova-compute[71654]:     <video>
Apr 11 20:42:51 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:42:51 user nova-compute[71654]:     </video>
Apr 11 20:42:51 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:42:51 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:42:51 user nova-compute[71654]:     </rng>
Apr 11 20:42:51 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:42:51 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:42:51 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:42:51 user nova-compute[71654]:     </memballoon>
Apr 11 20:42:51 user nova-compute[71654]:   </devices>
Apr 11 20:42:51 user nova-compute[71654]: </domain>
Apr 11 20:42:51 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345208448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345208448',id=16,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXzG/+iyFuLq/UP2Nf5869PwPaIxZUHlcTfcaQgIRL9ghHbGCVYa9ZHifqpcdGOoDPU/AR9Vn/W3qYR1rkx0sBJJpcHf1bVwdR/Ko66Ttz3Mo82/6YMPmg7BC5ao/FyXQ==',key_name='tempest-keypair-545600492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-voquowxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=4ad985d5-6fd0-48f3-be8f-00a7fc4791c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG os_vif [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70b946a4-09, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70b946a4-09, col_values=(('external_ids', {'iface-id': '70b946a4-0951-4e8c-adc6-ac21f5837691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c2:2c', 'vm-uuid': '4ad985d5-6fd0-48f3-be8f-00a7fc4791c4'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:51 user nova-compute[71654]: INFO os_vif [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09')
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:42:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No VIF found with MAC fa:16:3e:ef:c2:2c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:42:52 user nova-compute[71654]: DEBUG nova.network.neutron [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updated VIF entry in instance network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:42:52 user nova-compute[71654]: DEBUG nova.network.neutron [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:42:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ce788bba-c416-4214-9336-fad50f32578e req-fe2fb2b3-eaba-49b4-aacd-64a2d2b5f891 service nova] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:53 user nova-compute[71654]: WARNING nova.compute.manager [req-2eb00c46-bb0b-4432-ac92-41f04f0ca876 req-073f5a06-aff4-4319-879e-53340717ab0b service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state building and task_state spawning.
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245775.258784, 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] VM Resumed (Lifecycle Event)
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance spawned successfully.
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245775.2595735, 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] VM Started (Lifecycle Event)
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Took 5.48 seconds to spawn the instance on the hypervisor.
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:42:55 user nova-compute[71654]: INFO nova.compute.manager [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Took 6.13 seconds to build instance.
Apr 11 20:42:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e6509e3e-cabc-48a3-9422-d07e297df541 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.332s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:42:55 user nova-compute[71654]: WARNING nova.compute.manager [req-e370e15a-ae9a-4e7d-8910-4e6f9cebc8da req-e7a128a1-a56c-4961-b366-bbc95c1b9a4c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state active and task_state None.
Apr 11 20:42:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "05f0405b-e73d-4c84-8208-21194ab434d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:42:59 user nova-compute[71654]: INFO nova.compute.claims [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Claim successful on node user
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:42:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.policy [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:42:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Creating image(s)
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:42:59 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "764a059b-9ded-4d53-b960-ced4abe4323d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:43:00 user nova-compute[71654]: INFO nova.compute.claims [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Claim successful on node user
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245765.1953979, fe5fb157-6ca9-4e9f-87c6-11300909fdca => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:00 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] VM Stopped (Lifecycle Event)
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-609c7bd4-e29b-4423-be0e-f26ce01fcf8b None None] [instance: fe5fb157-6ca9-4e9f-87c6-11300909fdca] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk 1073741824" returned: 0 in 0.053s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Successfully created port: 730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Cannot resize image /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.objects.instance [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'migration_context' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Ensure instance console log exists: /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:43:00 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.policy [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:43:00 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Creating image(s)
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:00 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk 1073741824" returned: 0 in 0.049s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Successfully updated port: 730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-changed-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Refreshing instance network info cache due to event network-changed-730dc28f-1a82-4d35-af86-4a5744bd7ef0. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Acquiring lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Cannot resize image /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.objects.instance [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'migration_context' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Ensure instance console log exists: /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Successfully created port: 4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance network_info: |[{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Acquired lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Refreshing network info cache for port 730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Start _get_guest_xml network_info=[{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:43:01 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:01 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1539085704',display_name='tempest-ServerRescueNegativeTestJSON-server-1539085704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1539085704',id=17,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-4f9q1axh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:00Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=05f0405b-e73d-4c84-8208-21194ab434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.objects.instance [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:43:01 user nova-compute[71654]:   <uuid>05f0405b-e73d-4c84-8208-21194ab434d2</uuid>
Apr 11 20:43:01 user nova-compute[71654]:   <name>instance-00000011</name>
Apr 11 20:43:01 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:43:01 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:43:01 user nova-compute[71654]:   <metadata>
Apr 11 20:43:01 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:43:01 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:43:01 user nova-compute[71654]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1539085704</nova:name>
Apr 11 20:43:01 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:43:01</nova:creationTime>
Apr 11 20:43:01 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:43:01 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:43:01 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:43:01 user nova-compute[71654]:       <nova:owner>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:user uuid="dce0b6fa6d9546c8a04b7a4a5f93e0c7">tempest-ServerRescueNegativeTestJSON-777351805-project-member</nova:user>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:project uuid="a2ad2f73c14141dd8f7aa0d6f6c747b0">tempest-ServerRescueNegativeTestJSON-777351805</nova:project>
Apr 11 20:43:01 user nova-compute[71654]:       </nova:owner>
Apr 11 20:43:01 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:43:01 user nova-compute[71654]:       <nova:ports>
Apr 11 20:43:01 user nova-compute[71654]:         <nova:port uuid="730dc28f-1a82-4d35-af86-4a5744bd7ef0">
Apr 11 20:43:01 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:43:01 user nova-compute[71654]:         </nova:port>
Apr 11 20:43:01 user nova-compute[71654]:       </nova:ports>
Apr 11 20:43:01 user nova-compute[71654]:     </nova:instance>
Apr 11 20:43:01 user nova-compute[71654]:   </metadata>
Apr 11 20:43:01 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:43:01 user nova-compute[71654]:     <system>
Apr 11 20:43:01 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:43:01 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:43:01 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:43:01 user nova-compute[71654]:       <entry name="serial">05f0405b-e73d-4c84-8208-21194ab434d2</entry>
Apr 11 20:43:01 user nova-compute[71654]:       <entry name="uuid">05f0405b-e73d-4c84-8208-21194ab434d2</entry>
Apr 11 20:43:01 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:43:01 user nova-compute[71654]:     </system>
Apr 11 20:43:01 user nova-compute[71654]:   </sysinfo>
Apr 11 20:43:01 user nova-compute[71654]:   <os>
Apr 11 20:43:01 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:43:01 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:43:01 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:43:01 user nova-compute[71654]:   </os>
Apr 11 20:43:01 user nova-compute[71654]:   <features>
Apr 11 20:43:01 user nova-compute[71654]:     <acpi/>
Apr 11 20:43:01 user nova-compute[71654]:     <apic/>
Apr 11 20:43:01 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:43:01 user nova-compute[71654]:   </features>
Apr 11 20:43:01 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:43:01 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:43:01 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:43:01 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:43:01 user nova-compute[71654]:   </clock>
Apr 11 20:43:01 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:43:01 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:43:01 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:43:01 user nova-compute[71654]:   </cpu>
Apr 11 20:43:01 user nova-compute[71654]:   <devices>
Apr 11 20:43:01 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:43:01 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:43:01 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk"/>
Apr 11 20:43:01 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:43:01 user nova-compute[71654]:     </disk>
Apr 11 20:43:01 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:43:01 user nova-compute[71654]:       <mac address="fa:16:3e:f6:6b:1c"/>
Apr 11 20:43:01 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:43:01 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:43:01 user nova-compute[71654]:       <target dev="tap730dc28f-1a"/>
Apr 11 20:43:01 user nova-compute[71654]:     </interface>
Apr 11 20:43:01 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:43:01 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/console.log" append="off"/>
Apr 11 20:43:01 user nova-compute[71654]:     </serial>
Apr 11 20:43:01 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:43:01 user nova-compute[71654]:     <video>
Apr 11 20:43:01 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:43:01 user nova-compute[71654]:     </video>
Apr 11 20:43:01 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:43:01 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:43:01 user nova-compute[71654]:     </rng>
Apr 11 20:43:01 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:43:01 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:43:01 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:43:01 user nova-compute[71654]:     </memballoon>
Apr 11 20:43:01 user nova-compute[71654]:   </devices>
Apr 11 20:43:01 user nova-compute[71654]: </domain>
Apr 11 20:43:01 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1539085704',display_name='tempest-ServerRescueNegativeTestJSON-server-1539085704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1539085704',id=17,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-4f9q1axh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:00Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=05f0405b-e73d-4c84-8208-21194ab434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG os_vif [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap730dc28f-1a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap730dc28f-1a, col_values=(('external_ids', {'iface-id': '730dc28f-1a82-4d35-af86-4a5744bd7ef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:6b:1c', 'vm-uuid': '05f0405b-e73d-4c84-8208-21194ab434d2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:01 user nova-compute[71654]: INFO os_vif [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a')
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:43:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:f6:6b:1c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updated VIF entry in instance network info cache for port 730dc28f-1a82-4d35-af86-4a5744bd7ef0. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1f386058-e7a6-44aa-9a54-7772771b82f5 req-fa3d3a4c-680f-4413-98dd-d02e9aaaed40 service nova] Releasing lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Successfully updated port: 4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-changed-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Refreshing instance network info cache due to event network-changed-4698b719-9a11-4eae-9a8d-d736723b13bb. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Acquiring lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:02 user nova-compute[71654]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.neutron [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updating instance_info_cache with network_info: [{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance network_info: |[{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Acquired lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Refreshing network info cache for port 4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Start _get_guest_xml network_info=[{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:43:03 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:03 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-57617171',display_name='tempest-ServerRescueNegativeTestJSON-server-57617171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-57617171',id=18,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-d9rxhm4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:01Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=764a059b-9ded-4d53-b960-ced4abe4323d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'pci_devices' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:43:03 user nova-compute[71654]:   <uuid>764a059b-9ded-4d53-b960-ced4abe4323d</uuid>
Apr 11 20:43:03 user nova-compute[71654]:   <name>instance-00000012</name>
Apr 11 20:43:03 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:43:03 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:43:03 user nova-compute[71654]:   <metadata>
Apr 11 20:43:03 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:43:03 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:43:03 user nova-compute[71654]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-57617171</nova:name>
Apr 11 20:43:03 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:43:03</nova:creationTime>
Apr 11 20:43:03 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:43:03 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:43:03 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:43:03 user nova-compute[71654]:       <nova:owner>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:user uuid="dce0b6fa6d9546c8a04b7a4a5f93e0c7">tempest-ServerRescueNegativeTestJSON-777351805-project-member</nova:user>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:project uuid="a2ad2f73c14141dd8f7aa0d6f6c747b0">tempest-ServerRescueNegativeTestJSON-777351805</nova:project>
Apr 11 20:43:03 user nova-compute[71654]:       </nova:owner>
Apr 11 20:43:03 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:43:03 user nova-compute[71654]:       <nova:ports>
Apr 11 20:43:03 user nova-compute[71654]:         <nova:port uuid="4698b719-9a11-4eae-9a8d-d736723b13bb">
Apr 11 20:43:03 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 20:43:03 user nova-compute[71654]:         </nova:port>
Apr 11 20:43:03 user nova-compute[71654]:       </nova:ports>
Apr 11 20:43:03 user nova-compute[71654]:     </nova:instance>
Apr 11 20:43:03 user nova-compute[71654]:   </metadata>
Apr 11 20:43:03 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:43:03 user nova-compute[71654]:     <system>
Apr 11 20:43:03 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:43:03 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:43:03 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:43:03 user nova-compute[71654]:       <entry name="serial">764a059b-9ded-4d53-b960-ced4abe4323d</entry>
Apr 11 20:43:03 user nova-compute[71654]:       <entry name="uuid">764a059b-9ded-4d53-b960-ced4abe4323d</entry>
Apr 11 20:43:03 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:43:03 user nova-compute[71654]:     </system>
Apr 11 20:43:03 user nova-compute[71654]:   </sysinfo>
Apr 11 20:43:03 user nova-compute[71654]:   <os>
Apr 11 20:43:03 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:43:03 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:43:03 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:43:03 user nova-compute[71654]:   </os>
Apr 11 20:43:03 user nova-compute[71654]:   <features>
Apr 11 20:43:03 user nova-compute[71654]:     <acpi/>
Apr 11 20:43:03 user nova-compute[71654]:     <apic/>
Apr 11 20:43:03 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:43:03 user nova-compute[71654]:   </features>
Apr 11 20:43:03 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:43:03 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:43:03 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:43:03 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:43:03 user nova-compute[71654]:   </clock>
Apr 11 20:43:03 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:43:03 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:43:03 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:43:03 user nova-compute[71654]:   </cpu>
Apr 11 20:43:03 user nova-compute[71654]:   <devices>
Apr 11 20:43:03 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:43:03 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:43:03 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk"/>
Apr 11 20:43:03 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:43:03 user nova-compute[71654]:     </disk>
Apr 11 20:43:03 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:43:03 user nova-compute[71654]:       <mac address="fa:16:3e:83:1a:7b"/>
Apr 11 20:43:03 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:43:03 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:43:03 user nova-compute[71654]:       <target dev="tap4698b719-9a"/>
Apr 11 20:43:03 user nova-compute[71654]:     </interface>
Apr 11 20:43:03 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:43:03 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/console.log" append="off"/>
Apr 11 20:43:03 user nova-compute[71654]:     </serial>
Apr 11 20:43:03 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:43:03 user nova-compute[71654]:     <video>
Apr 11 20:43:03 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:43:03 user nova-compute[71654]:     </video>
Apr 11 20:43:03 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:43:03 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:43:03 user nova-compute[71654]:     </rng>
Apr 11 20:43:03 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:43:03 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:43:03 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:43:03 user nova-compute[71654]:     </memballoon>
Apr 11 20:43:03 user nova-compute[71654]:   </devices>
Apr 11 20:43:03 user nova-compute[71654]: </domain>
Apr 11 20:43:03 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-57617171',display_name='tempest-ServerRescueNegativeTestJSON-server-57617171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-57617171',id=18,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-d9rxhm4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:01Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=764a059b-9ded-4d53-b960-ced4abe4323d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG os_vif [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4698b719-9a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4698b719-9a, col_values=(('external_ids', {'iface-id': '4698b719-9a11-4eae-9a8d-d736723b13bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:1a:7b', 'vm-uuid': '764a059b-9ded-4d53-b960-ced4abe4323d'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: INFO os_vif [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a')
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:83:1a:7b, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updated VIF entry in instance network info cache for port 4698b719-9a11-4eae-9a8d-d736723b13bb. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updating instance_info_cache with network_info: [{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:43:03 user nova-compute[71654]: WARNING nova.compute.manager [req-a458f47e-0d13-4291-b0bc-0491775f7775 req-e1984b80-d73c-4969-b67e-dad224607b56 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state building and task_state spawning.
Apr 11 20:43:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3fe6dac7-3725-4a12-ba20-071dea1b91f3 req-3dce914c-281d-4711-8947-afdef6411ad9 service nova] Releasing lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:43:05 user nova-compute[71654]: WARNING nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state building and task_state spawning.
Apr 11 20:43:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:43:05 user nova-compute[71654]: WARNING nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state building and task_state spawning.
Apr 11 20:43:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:43:05 user nova-compute[71654]: WARNING nova.compute.manager [req-d1ff40df-a180-436c-88c5-9c7dac8addfb req-2e88f276-01f7-48e6-a1f6-b4d43c11ff32 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state building and task_state spawning.
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245786.5986676, 05f0405b-e73d-4c84-8208-21194ab434d2 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Resumed (Lifecycle Event)
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance spawned successfully.
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245786.602657, 05f0405b-e73d-4c84-8208-21194ab434d2 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Started (Lifecycle Event)
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:43:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Took 6.73 seconds to spawn the instance on the hypervisor.
Apr 11 20:43:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:06 user nova-compute[71654]: INFO nova.compute.manager [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Took 7.39 seconds to build instance.
Apr 11 20:43:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-94abb59a-78a1-4692-9b71-05ec869e5623 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "05f0405b-e73d-4c84-8208-21194ab434d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.648s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245787.2030625, 764a059b-9ded-4d53-b960-ced4abe4323d => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] VM Resumed (Lifecycle Event)
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance spawned successfully.
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245787.2033105, 764a059b-9ded-4d53-b960-ced4abe4323d => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] VM Started (Lifecycle Event)
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Took 6.51 seconds to spawn the instance on the hypervisor.
Apr 11 20:43:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:07 user nova-compute[71654]: INFO nova.compute.manager [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Took 7.34 seconds to build instance.
Apr 11 20:43:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-03b1d45d-ba5e-48cf-b85e-392b95f69f28 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "764a059b-9ded-4d53-b960-ced4abe4323d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.444s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.compute.manager [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.compute.manager [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing instance network info cache due to event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.network.neutron [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:43:09 user nova-compute[71654]: INFO nova.compute.claims [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Claim successful on node user
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.network.neutron [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updated VIF entry in instance network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG nova.network.neutron [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5320dd6e-327e-48ac-8fa5-0131be321cf5 req-167210e9-eda3-4250-998e-9e77c5ece998 service nova] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing instance network info cache due to event network-changed-cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.network.neutron [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Refreshing network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:43:10 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:43:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:10 user nova-compute[71654]: INFO nova.compute.manager [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Detaching volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:43:10 user nova-compute[71654]: INFO nova.virt.block_device [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Booting with blank volume at /dev/vda
Apr 11 20:43:10 user nova-compute[71654]: INFO nova.virt.block_device [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Attempting to driver detach volume 1f60ce4f-bf85-446c-bc26-6af1cc7dc546 from mountpoint /dev/vdb
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Attempting to detach device vdb from instance 6af82381-69fc-47e5-a16f-cea88c569240 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:43:10 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:43:10 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 20:43:10 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:43:10 user nova-compute[71654]:   <serial>1f60ce4f-bf85-446c-bc26-6af1cc7dc546</serial>
Apr 11 20:43:10 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:43:10 user nova-compute[71654]: </disk>
Apr 11 20:43:10 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:43:10 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully detached device vdb from instance 6af82381-69fc-47e5-a16f-cea88c569240 from the persistent domain config.
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6af82381-69fc-47e5-a16f-cea88c569240 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:43:10 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:43:10 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 20:43:10 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:43:10 user nova-compute[71654]:   <serial>1f60ce4f-bf85-446c-bc26-6af1cc7dc546</serial>
Apr 11 20:43:10 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:43:10 user nova-compute[71654]: </disk>
Apr 11 20:43:10 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.policy [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.network.neutron [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updated VIF entry in instance network info cache for port cff9d1b4-18f3-4450-8d38-f230812fb66e. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:43:10 user nova-compute[71654]: DEBUG nova.network.neutron [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5cc9418c-6229-4330-bfad-ab17703c7628 req-e2728e65-ad44-4718-a2b1-ae4966a661f7 service nova] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245791.335931, 6af82381-69fc-47e5-a16f-cea88c569240 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:43:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully detached device vdb from instance 6af82381-69fc-47e5-a16f-cea88c569240 from the live domain config.
Apr 11 20:43:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPinzWTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:43:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a9c7bf-1d69-4137-9cd8-b55738efd0b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:43:11 user nova-compute[71654]: No targets found.
Apr 11 20:43:11 user nova-compute[71654]: iSNS:
Apr 11 20:43:11 user nova-compute[71654]: No targets found.
Apr 11 20:43:11 user nova-compute[71654]: STATIC:
Apr 11 20:43:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546
Apr 11 20:43:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:43:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:43:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396
Apr 11 20:43:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:43:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:43:11 user nova-compute[71654]: FIRMWARE:
Apr 11 20:43:11 user nova-compute[71654]: No targets found.
Apr 11 20:43:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:43:11 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:43:11 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a44f45-26db-4aee-af3c-41aea1cc86ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[176fed6d-a9f9-4ce9-8768-7824a519d51c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:43:11 user nova-compute[71654]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:43:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 (non-flash)
Apr 11 20:43:11 user nova-compute[71654]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:43:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e68ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9585ec68-6f86-4003-864e-159b664a46ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02aef14-fab9-46a0-b166-0be10298b58a]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[be604603-367e-49f7-b6f3-a472b3669891]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8906175c-bfc5-44ac-9931-02f4b8a73a45]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd7c293-068e-4fd3-96ab-ce53e0b111b8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Successfully created port: 4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce787795-d2da-420f-b377-e6cd5771afe7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260]
Apr 11 20:43:11 user nova-compute[71654]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546, portal: 172.16.0.220,3260] successful.
Apr 11 20:43:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f60ce4f-bf85-446c-bc26-6af1cc7dc546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370d354-2978-4055-aa76-fe6c30df96f1]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== disconnect_volume: return (345ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:43:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Successfully updated port: 4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'flavor' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-changed-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Refreshing instance network info cache due to event network-changed-4d88bcd7-9de8-4278-9490-d4c866efebc4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Acquiring lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb101e4d-ba1b-48d5-bcb4-1131ccb432e0 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.018s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance network_info: |[{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Acquired lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:12 user nova-compute[71654]: DEBUG nova.network.neutron [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Refreshing network info cache for port 4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:43:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:13 user nova-compute[71654]: DEBUG nova.network.neutron [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updated VIF entry in instance network info cache for port 4d88bcd7-9de8-4278-9490-d4c866efebc4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:43:13 user nova-compute[71654]: DEBUG nova.network.neutron [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-43e9dce8-dbf8-4b8d-b68b-f07475c4b2c8 req-ad9d061f-ac93-41e9-b162-4da738b8cadb service nova] Releasing lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:13 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:15 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG os_brick.utils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fbd04b-35bb-4421-9ecb-c4f3ed6acea5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd3b55-128e-4a57-8ed5-67210a56a994]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a27e8b-8d63-4691-a45a-6288f2cd1360]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedeb11c-cda4-40e6-80cd-b3fe35c51ad0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:43:16 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd408a6c-8b36-4a1a-be54-a8ed38a38c10]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG os_brick.utils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating existing volume attachment record: de60948b-ca22-4d4e-a24f-0bed8f59cbd4 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:16 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:17 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:20 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:20 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7937MB free_disk=26.505863189697266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 6af82381-69fc-47e5-a16f-cea88c569240 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:43:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Creating image(s)
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Ensure instance console log exists: /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Start _get_guest_xml network_info=[{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '097d9483-07ea-4dce-afd6-4d28dd0d2390', 'attached_at': '', 'detached_at': '', 'volume_id': '625f97cf-09c8-456b-92ae-a757e4e74f3b', 'serial': '625f97cf-09c8-456b-92ae-a757e4e74f3b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'de60948b-ca22-4d4e-a24f-0bed8f59cbd4', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:43:20 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:20 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:43:20 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:43:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:43:20 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:43:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:43:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:43:20 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643df63-fbdb-45e8-8adf-0811518d2e59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:43:21 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a04c8-a6c8-4f74-a140-d4aa8f011c81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b] added
Apr 11 20:43:21 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3080e103-4f78-4e4e-a290-9165fae5ae17]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd0eca-c1a6-4e94-9a17-cca893d3d6fe]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkfhbGRe {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkfhbGRe" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9695ed-c4dd-49d2-9ad2-d29dc44e67db]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkfhbGRe'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c26e555-62cd-41e8-82e4-933cfef1838a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f302b86b-f3af-4226-abda-54b78652a666]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:43:21 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:43:21 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d384a8e5-593e-4bfb-a56a-067565ac2734]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260]
Apr 11 20:43:21 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260] successful.
Apr 11 20:43:21 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4ed64-1766-405f-9ec6-04eab4e9d9c6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[68712567-0936-4bb9-9165-e50cd7f1d797]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:43:21 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:43:21 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:43:21 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:43:21 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc0bde-f66a-418f-8b4b-9644c65978e9]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:43:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [{"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-6af82381-69fc-47e5-a16f-cea88c569240" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23962626462633535', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962626462633535', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-565746598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-565746598',id=19,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-pepmmnwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:11Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=097d9483-07ea-4dce-afd6-4d28dd0d2390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.objects.instance [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'pci_devices' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:43:22 user nova-compute[71654]:   <uuid>097d9483-07ea-4dce-afd6-4d28dd0d2390</uuid>
Apr 11 20:43:22 user nova-compute[71654]:   <name>instance-00000013</name>
Apr 11 20:43:22 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:43:22 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:43:22 user nova-compute[71654]:   <metadata>
Apr 11 20:43:22 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:43:22 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:43:22 user nova-compute[71654]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-565746598</nova:name>
Apr 11 20:43:22 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:43:20</nova:creationTime>
Apr 11 20:43:22 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:43:22 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:43:22 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:43:22 user nova-compute[71654]:       <nova:owner>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:user uuid="1d5cb62cc3844248be2e4456d970ccdf">tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member</nova:user>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:project uuid="85bf8fe34838426ea05060463458e5e0">tempest-ServerBootFromVolumeStableRescueTest-243239500</nova:project>
Apr 11 20:43:22 user nova-compute[71654]:       </nova:owner>
Apr 11 20:43:22 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:43:22 user nova-compute[71654]:       <nova:ports>
Apr 11 20:43:22 user nova-compute[71654]:         <nova:port uuid="4d88bcd7-9de8-4278-9490-d4c866efebc4">
Apr 11 20:43:22 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:43:22 user nova-compute[71654]:         </nova:port>
Apr 11 20:43:22 user nova-compute[71654]:       </nova:ports>
Apr 11 20:43:22 user nova-compute[71654]:     </nova:instance>
Apr 11 20:43:22 user nova-compute[71654]:   </metadata>
Apr 11 20:43:22 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:43:22 user nova-compute[71654]:     <system>
Apr 11 20:43:22 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:43:22 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:43:22 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:43:22 user nova-compute[71654]:       <entry name="serial">097d9483-07ea-4dce-afd6-4d28dd0d2390</entry>
Apr 11 20:43:22 user nova-compute[71654]:       <entry name="uuid">097d9483-07ea-4dce-afd6-4d28dd0d2390</entry>
Apr 11 20:43:22 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:43:22 user nova-compute[71654]:     </system>
Apr 11 20:43:22 user nova-compute[71654]:   </sysinfo>
Apr 11 20:43:22 user nova-compute[71654]:   <os>
Apr 11 20:43:22 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:43:22 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:43:22 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:43:22 user nova-compute[71654]:   </os>
Apr 11 20:43:22 user nova-compute[71654]:   <features>
Apr 11 20:43:22 user nova-compute[71654]:     <acpi/>
Apr 11 20:43:22 user nova-compute[71654]:     <apic/>
Apr 11 20:43:22 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:43:22 user nova-compute[71654]:   </features>
Apr 11 20:43:22 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:43:22 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:43:22 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:43:22 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:43:22 user nova-compute[71654]:   </clock>
Apr 11 20:43:22 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:43:22 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:43:22 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:43:22 user nova-compute[71654]:   </cpu>
Apr 11 20:43:22 user nova-compute[71654]:   <devices>
Apr 11 20:43:22 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:43:22 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:43:22 user nova-compute[71654]:       <source dev="/dev/sdc"/>
Apr 11 20:43:22 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:43:22 user nova-compute[71654]:       <serial>625f97cf-09c8-456b-92ae-a757e4e74f3b</serial>
Apr 11 20:43:22 user nova-compute[71654]:     </disk>
Apr 11 20:43:22 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:43:22 user nova-compute[71654]:       <mac address="fa:16:3e:11:00:a4"/>
Apr 11 20:43:22 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:43:22 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:43:22 user nova-compute[71654]:       <target dev="tap4d88bcd7-9d"/>
Apr 11 20:43:22 user nova-compute[71654]:     </interface>
Apr 11 20:43:22 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:43:22 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/console.log" append="off"/>
Apr 11 20:43:22 user nova-compute[71654]:     </serial>
Apr 11 20:43:22 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:43:22 user nova-compute[71654]:     <video>
Apr 11 20:43:22 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:43:22 user nova-compute[71654]:     </video>
Apr 11 20:43:22 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:43:22 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:43:22 user nova-compute[71654]:     </rng>
Apr 11 20:43:22 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:43:22 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:43:22 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:43:22 user nova-compute[71654]:     </memballoon>
Apr 11 20:43:22 user nova-compute[71654]:   </devices>
Apr 11 20:43:22 user nova-compute[71654]: </domain>
Apr 11 20:43:22 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-565746598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-565746598',id=19,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-pepmmnwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:11Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=097d9483-07ea-4dce-afd6-4d28dd0d2390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG os_vif [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d88bcd7-9d, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d88bcd7-9d, col_values=(('external_ids', {'iface-id': '4d88bcd7-9de8-4278-9490-d4c866efebc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:00:a4', 'vm-uuid': '097d9483-07ea-4dce-afd6-4d28dd0d2390'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:22 user nova-compute[71654]: INFO os_vif [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d')
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:43:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No VIF found with MAC fa:16:3e:11:00:a4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:43:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:43:24 user nova-compute[71654]: WARNING nova.compute.manager [req-a39184d9-a17b-460f-b926-2215680487e7 req-d4108fee-ffb4-4c93-879b-b23a3b881a6a service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state building and task_state spawning.
Apr 11 20:43:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245806.07875, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Resumed (Lifecycle Event)
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance spawned successfully.
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245806.0837383, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Started (Lifecycle Event)
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:43:26 user nova-compute[71654]: WARNING nova.compute.manager [req-d579cb65-0e3e-4566-97cb-340e4e006e89 req-9e2420ec-c8ec-41b0-a422-7130065813a4 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state building and task_state spawning.
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 11 20:43:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:43:26 user nova-compute[71654]: INFO nova.compute.manager [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Took 16.40 seconds to build instance.
Apr 11 20:43:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57fe7be0-0aca-4205-bce5-febb6ea0d014 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.515s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:43:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:43:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:43:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:43:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:43:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:43:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:43:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:02 user nova-compute[71654]: INFO nova.compute.manager [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Terminating instance
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-unplugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-unplugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-b49eebf4-47b6-4808-bf74-59aa76f5aa98 req-7fa353b8-a97b-461b-bc9a-1cc85efefd73 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-unplugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:44:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Instance destroyed successfully.
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.objects.instance [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'resources' on Instance uuid 6af82381-69fc-47e5-a16f-cea88c569240 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1961006747',display_name='tempest-TestMinimumBasicScenario-server-1961006747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1961006747',id=11,image_ref='34247816-448f-4660-9d3b-31800b7e69d9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr+uR5tvSQ91jM9X7rQtent5wesZdrD8MfTC3AhwLmT2ZAh/5dtWkoGKwHX/pV7h7v0BquiHS+LNoKqngQ3W404qxkaKNeUpEfLFjayzU4QxTDEcUXm9jHBq7/lcgPZsQ==',key_name='tempest-TestMinimumBasicScenario-338876043',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-7jdekc70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='34247816-448f-4660-9d3b-31800b7e69d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:41:27Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=6af82381-69fc-47e5-a16f-cea88c569240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "address": "fa:16:3e:5f:2d:da", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcff9d1b4-18", "ovs_interfaceid": "cff9d1b4-18f3-4450-8d38-f230812fb66e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG os_vif [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcff9d1b4-18, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:02 user nova-compute[71654]: INFO os_vif [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:2d:da,bridge_name='br-int',has_traffic_filtering=True,id=cff9d1b4-18f3-4450-8d38-f230812fb66e,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcff9d1b4-18')
Apr 11 20:44:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Deleting instance files /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240_del
Apr 11 20:44:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Deletion of /opt/stack/data/nova/instances/6af82381-69fc-47e5-a16f-cea88c569240_del complete
Apr 11 20:44:02 user nova-compute[71654]: INFO nova.compute.manager [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 20:44:02 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:44:02 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:03 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Took 0.48 seconds to deallocate network for instance.
Apr 11 20:44:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-deleted-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:03 user nova-compute[71654]: INFO nova.compute.manager [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Neutron deleted interface cff9d1b4-18f3-4450-8d38-f230812fb66e; detaching it from the instance and deleting it from the info cache
Apr 11 20:44:03 user nova-compute[71654]: DEBUG nova.network.neutron [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-1d193649-3454-47c4-aaf3-a48989b53216 req-26988624-2e35-4b45-991d-5055306a3a56 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Detach interface failed, port_id=cff9d1b4-18f3-4450-8d38-f230812fb66e, reason: Instance 6af82381-69fc-47e5-a16f-cea88c569240 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:03 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Deleted allocations for instance 6af82381-69fc-47e5-a16f-cea88c569240
Apr 11 20:44:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-61f73e1f-9ef5-4fdd-ae22-3e8494a7dcb8 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "6af82381-69fc-47e5-a16f-cea88c569240" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Acquiring lock "6af82381-69fc-47e5-a16f-cea88c569240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] Lock "6af82381-69fc-47e5-a16f-cea88c569240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] No waiting events found dispatching network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:04 user nova-compute[71654]: WARNING nova.compute.manager [req-b92e904e-2dae-49b2-bb49-885c7c9eaca1 req-d5def8ce-b36f-4820-9d99-0c89026f4449 service nova] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Received unexpected event network-vif-plugged-cff9d1b4-18f3-4450-8d38-f230812fb66e for instance with vm_state deleted and task_state None.
Apr 11 20:44:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'flavor' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:05 user nova-compute[71654]: INFO nova.compute.manager [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attaching volume cfcd112c-1532-4aa6-9cc4-b03448a34609 to /dev/vdb
Apr 11 20:44:06 user nova-compute[71654]: DEBUG os_brick.utils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9510248-e075-482c-a802-32a9d5158177]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df0a174-c8e0-4cce-b81f-f8eec8ce23d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b149142b-8598-48f9-af3f-be0a320eabf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb710d07-f8de-40a3-b77b-7b2eb1553857]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:44:06 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:44:06 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef0b8f-d499-4f23-90dd-49d2209a90cc]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG os_brick.utils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating existing volume attachment record: 26ea5a9c-07dc-48a2-8000-4fd23000bde3 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:44:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:10 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:10 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:10 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d58402e-8ab4-4318-b8ee-115b2556eee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:44:10 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edbc8ab-1ce6-46f5-9f9a-e7d6ee2a85fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609] added
Apr 11 20:44:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aacb925-c592-4291-bcfe-ced2b5527f15]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4247c-9e39-4f5f-8156-561741bdb69f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYsMFtAH {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYsMFtAH" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f837a-26ab-424c-ba56-3f92a924c8c8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYsMFtAH'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec3d7cd-e208-4268-a5cf-4691346ccb98]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[642463ea-d234-4a6f-844a-18146828bb21]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:10 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:10 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d347d702-7168-4598-97ce-2d44b814bca1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]
Apr 11 20:44:10 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.
Apr 11 20:44:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9994dd7-ba74-46bd-a90c-42593ce137ec]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58fb97f-e62c-4f05-a4ce-81bb6ca68758]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:10 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:10 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:10 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:10 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:10 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2d44c-f195-4ab9-9866-69c83e9ea5bc]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:10 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'info_cache' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance destroyed successfully.
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'resources' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap087e4499-cf, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:11 user nova-compute[71654]: INFO os_vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf')
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23832363261643230', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832363261643230', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.118s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'flavor' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeda794a-e0ea-4c25-8a75-a0e32ec04804]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:44:11 user nova-compute[71654]: No targets found.
Apr 11 20:44:11 user nova-compute[71654]: iSNS:
Apr 11 20:44:11 user nova-compute[71654]: No targets found.
Apr 11 20:44:11 user nova-compute[71654]: STATIC:
Apr 11 20:44:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:44:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:44:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:44:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396
Apr 11 20:44:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:44:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:44:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:44:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:44:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:44:11 user nova-compute[71654]: FIRMWARE:
Apr 11 20:44:11 user nova-compute[71654]: No targets found.
Apr 11 20:44:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:44:11 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:44:11 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:44:11 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:44:11 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:44:11 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:44:11 user nova-compute[71654]:   <serial>cfcd112c-1532-4aa6-9cc4-b03448a34609</serial>
Apr 11 20:44:11 user nova-compute[71654]: </disk>
Apr 11 20:44:11 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603867c-1695-46a9-a4a9-b7e8f6105495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff5b61-1a53-4103-9753-bc2c79f1271f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:11 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:11 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:11 user nova-compute[71654]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:11 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb4073e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f048eab-c4ed-48ea-a675-1c692d57b384]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c331b-1ea0-424d-8f8a-ad1be2cbcafb]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[522653b6-e60d-465d-b4a6-cdabfdce70e9]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d9bc5-8a46-4285-9d1a-2a08204eb1e8]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[56afb2bc-87f9-414d-89d0-851001bc7a37]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3738b6-8e3b-451d-af64-af94753be85f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]
Apr 11 20:44:11 user nova-compute[71654]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.
Apr 11 20:44:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5df5a4-3fad-4333-b127-e8d02df3d518]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== disconnect_volume: return (439ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start _get_guest_xml network_info=[{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9613dc9f-5683-4139-bbed-0c2a11c2dc31', 'attached_at': '', 'detached_at': '', 'volume_id': '042389e0-da53-4582-ae52-c57ba7f3c396', 'serial': '042389e0-da53-4582-ae52-c57ba7f3c396'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'c9f23a9e-9503-42d6-b4d7-5e2de7d094f5', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'numa_topology' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:11 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:11 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:12 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:12 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf39a48-5063-4f20-920f-2c1af02c3283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:44:12 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:76:b1:a7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2479e0d-0368-457e-bd97-95d037b1290e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396] added
Apr 11 20:44:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5542b3bd-6df4-4446-8df3-b40eb2818dfd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[715e7574-2b23-4694-8264-1e382b280f07]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiKRfdeV {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZiKRfdeV" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c00c5a-6dd5-4e4d-8731-e073339e5db4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZiKRfdeV'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17b7ed7-d1d8-468f-b1bf-d16fb4d39202]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[39955e5b-f231-4e8a-89c0-a2f498550741]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:12 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:12 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19581aff-5629-4126-82dc-0af087fe437e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.180s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[028789df-b6d6-4fe4-a090-f6d97ee5f725]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]
Apr 11 20:44:12 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.
Apr 11 20:44:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9126bf-1b75-4d03-bb2b-64d6fd1bd829]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fa4e70-bbd4-4acb-9fe3-9152d96d8347]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:12 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:12 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:12 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:12 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a02344-21d8-4ce8-aba6-eb35fae38866]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:44:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26131393434623033', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131393434623033', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'pci_devices' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:44:13 user nova-compute[71654]:   <uuid>9613dc9f-5683-4139-bbed-0c2a11c2dc31</uuid>
Apr 11 20:44:13 user nova-compute[71654]:   <name>instance-0000000e</name>
Apr 11 20:44:13 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:44:13 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:44:13 user nova-compute[71654]:   <metadata>
Apr 11 20:44:13 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:44:13 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:44:13 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeTestJSON-server-1899891318</nova:name>
Apr 11 20:44:13 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:44:11</nova:creationTime>
Apr 11 20:44:13 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:44:13 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:44:13 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:44:13 user nova-compute[71654]:       <nova:owner>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:user uuid="3c9f583cc98040bc822e1ac7e418aa98">tempest-AttachVolumeTestJSON-968541948-project-member</nova:user>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:project uuid="426d5e042ba34969a2bfdc0c89da11e8">tempest-AttachVolumeTestJSON-968541948</nova:project>
Apr 11 20:44:13 user nova-compute[71654]:       </nova:owner>
Apr 11 20:44:13 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:44:13 user nova-compute[71654]:       <nova:ports>
Apr 11 20:44:13 user nova-compute[71654]:         <nova:port uuid="087e4499-cfde-448a-b093-08f4b879f946">
Apr 11 20:44:13 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 20:44:13 user nova-compute[71654]:         </nova:port>
Apr 11 20:44:13 user nova-compute[71654]:       </nova:ports>
Apr 11 20:44:13 user nova-compute[71654]:     </nova:instance>
Apr 11 20:44:13 user nova-compute[71654]:   </metadata>
Apr 11 20:44:13 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:44:13 user nova-compute[71654]:     <system>
Apr 11 20:44:13 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:44:13 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:44:13 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:44:13 user nova-compute[71654]:       <entry name="serial">9613dc9f-5683-4139-bbed-0c2a11c2dc31</entry>
Apr 11 20:44:13 user nova-compute[71654]:       <entry name="uuid">9613dc9f-5683-4139-bbed-0c2a11c2dc31</entry>
Apr 11 20:44:13 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:44:13 user nova-compute[71654]:     </system>
Apr 11 20:44:13 user nova-compute[71654]:   </sysinfo>
Apr 11 20:44:13 user nova-compute[71654]:   <os>
Apr 11 20:44:13 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:44:13 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:44:13 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:44:13 user nova-compute[71654]:   </os>
Apr 11 20:44:13 user nova-compute[71654]:   <features>
Apr 11 20:44:13 user nova-compute[71654]:     <acpi/>
Apr 11 20:44:13 user nova-compute[71654]:     <apic/>
Apr 11 20:44:13 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:44:13 user nova-compute[71654]:   </features>
Apr 11 20:44:13 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:44:13 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:44:13 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:44:13 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:44:13 user nova-compute[71654]:   </clock>
Apr 11 20:44:13 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:44:13 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:44:13 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:44:13 user nova-compute[71654]:   </cpu>
Apr 11 20:44:13 user nova-compute[71654]:   <devices>
Apr 11 20:44:13 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:13 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:13 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk"/>
Apr 11 20:44:13 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:44:13 user nova-compute[71654]:     </disk>
Apr 11 20:44:13 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:44:13 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:44:13 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:44:13 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:44:13 user nova-compute[71654]:       <serial>042389e0-da53-4582-ae52-c57ba7f3c396</serial>
Apr 11 20:44:13 user nova-compute[71654]:     </disk>
Apr 11 20:44:13 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:44:13 user nova-compute[71654]:       <mac address="fa:16:3e:1a:3b:8b"/>
Apr 11 20:44:13 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:13 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:44:13 user nova-compute[71654]:       <target dev="tap087e4499-cf"/>
Apr 11 20:44:13 user nova-compute[71654]:     </interface>
Apr 11 20:44:13 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:44:13 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/console.log" append="off"/>
Apr 11 20:44:13 user nova-compute[71654]:     </serial>
Apr 11 20:44:13 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:44:13 user nova-compute[71654]:     <video>
Apr 11 20:44:13 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:13 user nova-compute[71654]:     </video>
Apr 11 20:44:13 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:44:13 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:44:13 user nova-compute[71654]:     </rng>
Apr 11 20:44:13 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:44:13 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:44:13 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:44:13 user nova-compute[71654]:     </memballoon>
Apr 11 20:44:13 user nova-compute[71654]:   </devices>
Apr 11 20:44:13 user nova-compute[71654]: </domain>
Apr 11 20:44:13 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Stashing vm_state: active {{(pid=71654) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Cannot resize image /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'migration_context' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:42:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG os_vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap087e4499-cf, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap087e4499-cf, col_values=(('external_ids', {'iface-id': '087e4499-cfde-448a-b093-08f4b879f946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:3b:8b', 'vm-uuid': '9613dc9f-5683-4139-bbed-0c2a11c2dc31'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:13 user nova-compute[71654]: INFO os_vif [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf')
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_requests' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:44:14 user nova-compute[71654]: INFO nova.compute.claims [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Claim successful on node user
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_devices' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:14 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating resource usage from migration 6672ac3a-0050-4d08-9611-9cee52d50588
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.428s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:14 user nova-compute[71654]: INFO nova.compute.manager [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Migrating
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:14 user nova-compute[71654]: INFO nova.compute.rpcapi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:14 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Starting migrate_disk_and_power_off {{(pid=71654) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:15 user nova-compute[71654]: WARNING nova.compute.manager [req-f4a89a79-c640-4c1b-ac69-c306cafd53a8 req-cdc75880-f652-4a56-8482-e6e558bd36b4 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state resize_migrating.
Apr 11 20:44:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:15 user nova-compute[71654]: WARNING nova.compute.manager [req-c74e8930-7290-4b3e-b891-751970202778 req-9c120af3-8979-4018-9455-3105eec7512c service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state stopped and task_state powering-on.
Apr 11 20:44:15 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance destroyed successfully.
Apr 11 20:44:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21864ca9-0a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: INFO os_vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:44:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:16 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d0a150-156c-46a5-ac90-255bf379af43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:44:16 user nova-compute[71654]: No targets found.
Apr 11 20:44:16 user nova-compute[71654]: iSNS:
Apr 11 20:44:16 user nova-compute[71654]: No targets found.
Apr 11 20:44:16 user nova-compute[71654]: STATIC:
Apr 11 20:44:16 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:44:16 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:44:16 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:44:16 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396
Apr 11 20:44:16 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:44:16 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:44:16 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:44:16 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:44:16 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:44:16 user nova-compute[71654]: FIRMWARE:
Apr 11 20:44:16 user nova-compute[71654]: No targets found.
Apr 11 20:44:16 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:44:16 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:44:16 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad77cb8e-b51d-43c7-9c27-909750b7d3b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9539af99-32f8-480e-b490-283bd979e66a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:16 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:16 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:16 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:16 user nova-compute[71654]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:16 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:16 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb40742560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a15dd47-3831-429b-b3ef-f1517efd3c0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee81dcc-1d2c-4767-af0d-0843d9922b6e]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fb2aa0-f5b9-48cd-af9f-c0c0c2848613]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3413ab3f-4ed3-4307-9922-4d117f2d68c1]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c5312f-f45f-431b-b2ba-b7a9b8c3ebc7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167c9e7-f7f9-4eb6-81ab-bcaff738e6ed]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]
Apr 11 20:44:16 user nova-compute[71654]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.
Apr 11 20:44:16 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[df740362-d993-4dcc-8ee9-a97ff492e74b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (340ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_resize/disk /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "cp -r /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_resize/disk /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk" returned: 0 in 0.173s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_resize/disk.info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "cp -r /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_resize/disk.info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk.info" returned: 0 in 0.038s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:17 user nova-compute[71654]: WARNING nova.compute.manager [req-8eb15241-6613-4388-94b3-0e947d9b6132 req-a548deb1-9b65-499d-b2b2-7e5f07fc3180 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state resize_migrating.
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:17 user nova-compute[71654]: WARNING nova.compute.manager [req-1947d622-05f7-4723-a2fa-6c9bfc9dbb37 req-ecc771f2-bda2-432f-b04b-8b6510b60993 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state stopped and task_state powering-on.
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245842.8432374, 6af82381-69fc-47e5-a16f-cea88c569240 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:17 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] VM Stopped (Lifecycle Event)
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245857.8441012, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:17 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Resumed (Lifecycle Event)
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:44:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance rebooted successfully.
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7794ec82-5b25-44af-9fed-d0344cb84793 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-f9ff82b7-2f59-4325-bf9f-5d77a01e37da None None] [instance: 6af82381-69fc-47e5-a16f-cea88c569240] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:17 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245857.8499665, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:17 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Started (Lifecycle Event)
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:17 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:17 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Port 21864ca9-0ae0-4591-a5bc-fac2428743cb binding to destination host user is already ACTIVE {{(pid=71654) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG os_brick.utils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c2a25e-962f-44ef-8ec8-d89ea32deb32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa20277-84e3-46f7-b5b0-5a5a3251fef9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a944e170-f288-4e0f-b8fb-9dcf6648aaea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb90ad-4828-4c09-885a-de934b7ba7db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:44:19 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cf2711-f67e-41c2-b944-92811d28d2ce]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG os_brick.utils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:44:20 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:20 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=26.45357894897461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Applying migration context for instance dadac585-3a7c-40d8-a335-fc2603588c28 as it has an incoming, in-progress migration 6672ac3a-0050-4d08-9611-9cee52d50588. Migration status is post-migrating {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 20:44:20 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating resource usage from migration 6672ac3a-0050-4d08-9611-9cee52d50588
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Migration 6672ac3a-0050-4d08-9611-9cee52d50588 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:44:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:44:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:21 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:21 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:21 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:44:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:44:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:44:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:23 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:44:23 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:23 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Starting finish_migration {{(pid=71654) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:44:24 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Creating image(s)
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'trusted_certs' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.167s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Cannot resize image /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Ensure instance console log exists: /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start _get_guest_xml network_info=[{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dadac585-3a7c-40d8-a335-fc2603588c28', 'attached_at': '2023-04-11T20:44:24.000000', 'detached_at': '', 'volume_id': 'cfcd112c-1532-4aa6-9cc4-b03448a34609', 'serial': 'cfcd112c-1532-4aa6-9cc4-b03448a34609'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'eab5458a-ec09-4c6a-a57a-6ab3df8106c2', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:44:24 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:24 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'vcpu_model' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:24 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:24 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:24 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c671cb-0918-4b25-80c5-c197cca6e933]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:44:24 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb4527-7ac6-4adc-90ef-c9a65727969c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609] added
Apr 11 20:44:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5568e624-a2aa-4658-a4ce-8cd3b9db2338]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffe2a02-0b32-4313-87be-22b8c6ced69a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYsMFtAH {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYsMFtAH" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4aa9e-0b9d-4dbf-8992-6c08acb6ab84]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYsMFtAH'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f3b79-8b52-4b41-a641-b4ba27765516]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c7fbbe-e354-4e76-b05f-7c57578e53b1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:24 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:24 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da728bb-b28f-4c56-b93d-2f37ab3c81bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]
Apr 11 20:44:24 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.
Apr 11 20:44:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d3ee2-7654-4709-8f01-584bf851fefb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ada787-cc77-46ee-892e-4dfa62843644]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:24 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:24 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:24 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:24 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fd7bc-98f9-4c99-9878-5d2e6151011f]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:44:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:44:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23832363261643230', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832363261643230', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:44:26 user nova-compute[71654]:   <uuid>dadac585-3a7c-40d8-a335-fc2603588c28</uuid>
Apr 11 20:44:26 user nova-compute[71654]:   <name>instance-00000003</name>
Apr 11 20:44:26 user nova-compute[71654]:   <memory>196608</memory>
Apr 11 20:44:26 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:44:26 user nova-compute[71654]:   <metadata>
Apr 11 20:44:26 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:44:26 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:44:26 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-1788631209</nova:name>
Apr 11 20:44:26 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:44:24</nova:creationTime>
Apr 11 20:44:26 user nova-compute[71654]:       <nova:flavor name="m1.micro">
Apr 11 20:44:26 user nova-compute[71654]:         <nova:memory>192</nova:memory>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:44:26 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:44:26 user nova-compute[71654]:       <nova:owner>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:44:26 user nova-compute[71654]:       </nova:owner>
Apr 11 20:44:26 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:44:26 user nova-compute[71654]:       <nova:ports>
Apr 11 20:44:26 user nova-compute[71654]:         <nova:port uuid="21864ca9-0ae0-4591-a5bc-fac2428743cb">
Apr 11 20:44:26 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:44:26 user nova-compute[71654]:         </nova:port>
Apr 11 20:44:26 user nova-compute[71654]:       </nova:ports>
Apr 11 20:44:26 user nova-compute[71654]:     </nova:instance>
Apr 11 20:44:26 user nova-compute[71654]:   </metadata>
Apr 11 20:44:26 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:44:26 user nova-compute[71654]:     <system>
Apr 11 20:44:26 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:44:26 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:44:26 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:44:26 user nova-compute[71654]:       <entry name="serial">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:44:26 user nova-compute[71654]:       <entry name="uuid">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:44:26 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:44:26 user nova-compute[71654]:     </system>
Apr 11 20:44:26 user nova-compute[71654]:   </sysinfo>
Apr 11 20:44:26 user nova-compute[71654]:   <os>
Apr 11 20:44:26 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:44:26 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:44:26 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:44:26 user nova-compute[71654]:   </os>
Apr 11 20:44:26 user nova-compute[71654]:   <features>
Apr 11 20:44:26 user nova-compute[71654]:     <acpi/>
Apr 11 20:44:26 user nova-compute[71654]:     <apic/>
Apr 11 20:44:26 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:44:26 user nova-compute[71654]:   </features>
Apr 11 20:44:26 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:44:26 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:44:26 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:44:26 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:44:26 user nova-compute[71654]:   </clock>
Apr 11 20:44:26 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:44:26 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:44:26 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:44:26 user nova-compute[71654]:   </cpu>
Apr 11 20:44:26 user nova-compute[71654]:   <devices>
Apr 11 20:44:26 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:26 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:26 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk"/>
Apr 11 20:44:26 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:44:26 user nova-compute[71654]:     </disk>
Apr 11 20:44:26 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:44:26 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:44:26 user nova-compute[71654]:       <source dev="/dev/sdd"/>
Apr 11 20:44:26 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:44:26 user nova-compute[71654]:       <serial>cfcd112c-1532-4aa6-9cc4-b03448a34609</serial>
Apr 11 20:44:26 user nova-compute[71654]:     </disk>
Apr 11 20:44:26 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:44:26 user nova-compute[71654]:       <mac address="fa:16:3e:76:b1:a7"/>
Apr 11 20:44:26 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:26 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:44:26 user nova-compute[71654]:       <target dev="tap21864ca9-0a"/>
Apr 11 20:44:26 user nova-compute[71654]:     </interface>
Apr 11 20:44:26 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:44:26 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log" append="off"/>
Apr 11 20:44:26 user nova-compute[71654]:     </serial>
Apr 11 20:44:26 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:44:26 user nova-compute[71654]:     <video>
Apr 11 20:44:26 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:26 user nova-compute[71654]:     </video>
Apr 11 20:44:26 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:44:26 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:44:26 user nova-compute[71654]:     </rng>
Apr 11 20:44:26 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:44:26 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:44:26 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:44:26 user nova-compute[71654]:     </memballoon>
Apr 11 20:44:26 user nova-compute[71654]:   </devices>
Apr 11 20:44:26 user nova-compute[71654]: </domain>
Apr 11 20:44:26 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:76:b1:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG os_vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21864ca9-0a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21864ca9-0a, col_values=(('external_ids', {'iface-id': '21864ca9-0ae0-4591-a5bc-fac2428743cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b1:a7', 'vm-uuid': 'dadac585-3a7c-40d8-a335-fc2603588c28'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:26 user nova-compute[71654]: INFO os_vif [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:76:b1:a7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:27 user nova-compute[71654]: WARNING nova.compute.manager [req-1415c339-9abc-4588-9430-c2fb70d4a7ce req-a1662424-d3ef-40cb-bae9-b1757578a835 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state resize_finish.
Apr 11 20:44:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for dadac585-3a7c-40d8-a335-fc2603588c28 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245869.6319902, dadac585-3a7c-40d8-a335-fc2603588c28 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:29 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Resumed (Lifecycle Event)
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:44:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance running successfully.
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Failed to set time: agent not configured {{(pid=71654) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3ac6a763-151e-4366-9e85-e3076e054f82 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] finish_migration finished successfully. {{(pid=71654) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:29 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245869.637381, dadac585-3a7c-40d8-a335-fc2603588c28 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:29 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Started (Lifecycle Event)
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:29 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:29 user nova-compute[71654]: WARNING nova.compute.manager [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state resize_finish.
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-changed-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Refreshing instance network info cache due to event network-changed-7e936873-bcfe-497e-b850-374d6ae930a6. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Acquiring lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Acquired lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:29 user nova-compute[71654]: DEBUG nova.network.neutron [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Refreshing network info cache for port 7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:44:30 user nova-compute[71654]: INFO nova.compute.claims [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Claim successful on node user
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.network.neutron [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updated VIF entry in instance network info cache for port 7e936873-bcfe-497e-b850-374d6ae930a6. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.network.neutron [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updating instance_info_cache with network_info: [{"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00f09220-b491-4fbb-a10f-502757984517 req-24a4a8b0-ee42-4231-9085-f9c51e149da3 service nova] Releasing lock "refresh_cache-645e96f7-547e-4eea-8523-7f7918c0ad3e" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:44:30 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.policy [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:44:30 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Creating image(s)
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "/opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "/opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.164s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk 1073741824" returned: 0 in 0.056s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.161s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Cannot resize image /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'migration_context' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Ensure instance console log exists: /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:31 user nova-compute[71654]: INFO nova.compute.manager [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Attaching volume 5a6c57cf-e717-411e-98df-be3d3706bc6c to /dev/vdb
Apr 11 20:44:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG os_brick.utils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b96b20-57fd-4759-9cba-5fdf43f07d05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[938aec31-9267-4948-8c06-40cf8a2fe6d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0be46e-11a9-4246-8224-b58be6e517f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19eb697-ad82-41d5-8745-8ac8331f6281]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:44:31 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:44:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[27618e26-61ac-492d-979c-414ff704fe3e]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG os_brick.utils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:31 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updating existing volume attachment record: dbff8805-adf7-4d0c-9b41-e56307f1fd29 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:44:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Successfully created port: 704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Successfully updated port: 704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "refresh_cache-4c52ef94-8660-49a4-8105-5b63bfb187ff" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquired lock "refresh_cache-4c52ef94-8660-49a4-8105-5b63bfb187ff" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received event network-changed-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Refreshing instance network info cache due to event network-changed-704fb865-76f6-4e89-b6f8-b69854f4bcc6. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Acquiring lock "refresh_cache-4c52ef94-8660-49a4-8105-5b63bfb187ff" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Updating instance_info_cache with network_info: [{"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Releasing lock "refresh_cache-4c52ef94-8660-49a4-8105-5b63bfb187ff" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Instance network_info: |[{"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Acquired lock "refresh_cache-4c52ef94-8660-49a4-8105-5b63bfb187ff" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Refreshing network info cache for port 704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Start _get_guest_xml network_info=[{"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:44:33 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:33 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-860608246',display_name='tempest-VolumesSnapshotTestJSON-instance-860608246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-860608246',id=20,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1982dc9f62644e2b8a541dc25854a6a9',ramdisk_id='',reservation_id='r-pp4bza0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-323644922',owner_user_name='tempest-VolumesSnapshotTestJSON-323644922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:31Z,user_data=None,user_id='94e4de8a85394d258268ff4304eccb2d',uuid=4c52ef94-8660-49a4-8105-5b63bfb187ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converting VIF {"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:44:33 user nova-compute[71654]:   <uuid>4c52ef94-8660-49a4-8105-5b63bfb187ff</uuid>
Apr 11 20:44:33 user nova-compute[71654]:   <name>instance-00000014</name>
Apr 11 20:44:33 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:44:33 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:44:33 user nova-compute[71654]:   <metadata>
Apr 11 20:44:33 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:44:33 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:44:33 user nova-compute[71654]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-860608246</nova:name>
Apr 11 20:44:33 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:44:33</nova:creationTime>
Apr 11 20:44:33 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:44:33 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:44:33 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:44:33 user nova-compute[71654]:       <nova:owner>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:user uuid="94e4de8a85394d258268ff4304eccb2d">tempest-VolumesSnapshotTestJSON-323644922-project-member</nova:user>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:project uuid="1982dc9f62644e2b8a541dc25854a6a9">tempest-VolumesSnapshotTestJSON-323644922</nova:project>
Apr 11 20:44:33 user nova-compute[71654]:       </nova:owner>
Apr 11 20:44:33 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:44:33 user nova-compute[71654]:       <nova:ports>
Apr 11 20:44:33 user nova-compute[71654]:         <nova:port uuid="704fb865-76f6-4e89-b6f8-b69854f4bcc6">
Apr 11 20:44:33 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 20:44:33 user nova-compute[71654]:         </nova:port>
Apr 11 20:44:33 user nova-compute[71654]:       </nova:ports>
Apr 11 20:44:33 user nova-compute[71654]:     </nova:instance>
Apr 11 20:44:33 user nova-compute[71654]:   </metadata>
Apr 11 20:44:33 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:44:33 user nova-compute[71654]:     <system>
Apr 11 20:44:33 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:44:33 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:44:33 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:44:33 user nova-compute[71654]:       <entry name="serial">4c52ef94-8660-49a4-8105-5b63bfb187ff</entry>
Apr 11 20:44:33 user nova-compute[71654]:       <entry name="uuid">4c52ef94-8660-49a4-8105-5b63bfb187ff</entry>
Apr 11 20:44:33 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:44:33 user nova-compute[71654]:     </system>
Apr 11 20:44:33 user nova-compute[71654]:   </sysinfo>
Apr 11 20:44:33 user nova-compute[71654]:   <os>
Apr 11 20:44:33 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:44:33 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:44:33 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:44:33 user nova-compute[71654]:   </os>
Apr 11 20:44:33 user nova-compute[71654]:   <features>
Apr 11 20:44:33 user nova-compute[71654]:     <acpi/>
Apr 11 20:44:33 user nova-compute[71654]:     <apic/>
Apr 11 20:44:33 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:44:33 user nova-compute[71654]:   </features>
Apr 11 20:44:33 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:44:33 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:44:33 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:44:33 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:44:33 user nova-compute[71654]:   </clock>
Apr 11 20:44:33 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:44:33 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:44:33 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:44:33 user nova-compute[71654]:   </cpu>
Apr 11 20:44:33 user nova-compute[71654]:   <devices>
Apr 11 20:44:33 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:33 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:33 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk"/>
Apr 11 20:44:33 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:44:33 user nova-compute[71654]:     </disk>
Apr 11 20:44:33 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:44:33 user nova-compute[71654]:       <mac address="fa:16:3e:db:e5:5a"/>
Apr 11 20:44:33 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:33 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:44:33 user nova-compute[71654]:       <target dev="tap704fb865-76"/>
Apr 11 20:44:33 user nova-compute[71654]:     </interface>
Apr 11 20:44:33 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:44:33 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/console.log" append="off"/>
Apr 11 20:44:33 user nova-compute[71654]:     </serial>
Apr 11 20:44:33 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:44:33 user nova-compute[71654]:     <video>
Apr 11 20:44:33 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:33 user nova-compute[71654]:     </video>
Apr 11 20:44:33 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:44:33 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:44:33 user nova-compute[71654]:     </rng>
Apr 11 20:44:33 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:44:33 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:44:33 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:44:33 user nova-compute[71654]:     </memballoon>
Apr 11 20:44:33 user nova-compute[71654]:   </devices>
Apr 11 20:44:33 user nova-compute[71654]: </domain>
Apr 11 20:44:33 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-860608246',display_name='tempest-VolumesSnapshotTestJSON-instance-860608246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-860608246',id=20,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1982dc9f62644e2b8a541dc25854a6a9',ramdisk_id='',reservation_id='r-pp4bza0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-323644922',owner_user_name='tempest-VolumesSnapshotTestJSON-323644922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:31Z,user_data=None,user_id='94e4de8a85394d258268ff4304eccb2d',uuid=4c52ef94-8660-49a4-8105-5b63bfb187ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converting VIF {"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG os_vif [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap704fb865-76, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap704fb865-76, col_values=(('external_ids', {'iface-id': '704fb865-76f6-4e89-b6f8-b69854f4bcc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:e5:5a', 'vm-uuid': '4c52ef94-8660-49a4-8105-5b63bfb187ff'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:33 user nova-compute[71654]: INFO os_vif [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76')
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No VIF found with MAC fa:16:3e:db:e5:5a, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Updated VIF entry in instance network info cache for port 704fb865-76f6-4e89-b6f8-b69854f4bcc6. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Updating instance_info_cache with network_info: [{"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-56457ea0-d979-4574-a08f-9eab2e171be2 req-a6dbb63b-f89e-4dff-a142-f2948b976f2c service nova] Releasing lock "refresh_cache-4c52ef94-8660-49a4-8105-5b63bfb187ff" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received event network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] No waiting events found dispatching network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:35 user nova-compute[71654]: WARNING nova.compute.manager [req-965695fb-9603-4d36-90ad-fb341e09ef3e req-e9832e24-1256-4c5a-82ab-e92465215fd5 service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received unexpected event network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance with vm_state building and task_state spawning.
Apr 11 20:44:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeiqMXOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:44:36 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:36 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:44:36 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679c23c-9bef-423b-9e12-3299272ed437]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:44:36 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1448f-577d-4775-8df8-6896e82f558a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c] added
Apr 11 20:44:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afe64c-9cf6-4598-af39-f9c35750983c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f08875-ec61-4338-a3d4-e47ed9c1af20]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeiqMXOD {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeiqMXOD" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1bf8b-bbb2-4232-871f-5791ff4c94d0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeiqMXOD'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5f2d3-45d2-4864-9ba9-f61c732ac7e6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2b6b6-907f-4222-9920-26809b26c674]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb556c4-a45c-432c-9096-69f15f306c1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260]
Apr 11 20:44:36 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260] successful.
Apr 11 20:44:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d3fb4-a3e2-45bb-8405-8026237aec7a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a6567-641b-42ad-ae68-87886f0502de]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:44:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:44:36 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:44:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e2874c-e1cf-407f-8e40-6832997febd7]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeiqMXOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:44:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245877.0596695, 4c52ef94-8660-49a4-8105-5b63bfb187ff => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] VM Resumed (Lifecycle Event)
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Instance spawned successfully.
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245877.0615718, 4c52ef94-8660-49a4-8105-5b63bfb187ff => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] VM Started (Lifecycle Event)
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Took 6.35 seconds to spawn the instance on the hypervisor.
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received event network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] No waiting events found dispatching network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:37 user nova-compute[71654]: WARNING nova.compute.manager [req-ad5bb221-7a1a-47c5-a2fa-6aad984996bf req-95b3fc0b-b924-4538-8867-47af9363e387 service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received unexpected event network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance with vm_state building and task_state spawning.
Apr 11 20:44:37 user nova-compute[71654]: INFO nova.compute.manager [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Took 7.18 seconds to build instance.
Apr 11 20:44:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6f57b67f-6234-477a-8704-1cd4ae7d8f40 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.295s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26465346563353162', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465346563353162', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:44:37 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:44:37 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:44:37 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:44:37 user nova-compute[71654]:   <serial>5a6c57cf-e717-411e-98df-be3d3706bc6c</serial>
Apr 11 20:44:37 user nova-compute[71654]: </disk>
Apr 11 20:44:37 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:44:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:6e:74:f1, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3219c8e5-a331-4a15-9748-2772c88f7b19 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.497s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing instance network info cache due to event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:44:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:40 user nova-compute[71654]: DEBUG nova.network.neutron [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:44:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updated VIF entry in instance network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:44:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-645e54c6-8c53-4efd-84dc-e2fcafc77634 req-abf6010a-009e-41f5-99fc-db9bd74b4755 service nova] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:44:43 user nova-compute[71654]: INFO nova.compute.claims [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Claim successful on node user
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:43 user nova-compute[71654]: INFO nova.compute.manager [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Shelving
Apr 11 20:44:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-unplugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-unplugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:43 user nova-compute[71654]: WARNING nova.compute.manager [req-f81be815-911c-458d-b10a-565fcb75e7ca req-c5725f3d-d161-4765-a980-99bc2f77482c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-unplugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state active and task_state shelving.
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:44:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance destroyed successfully.
Apr 11 20:44:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:44:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:44:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Beginning cold snapshot process
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.policy [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:44:44 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Creating image(s)
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk /opt/stack/data/nova/instances/snapshots/tmpdqq_fdh6/608f98b1fbcc4400a2f318eb2d0eb850 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.160s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk 1073741824" returned: 0 in 0.083s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk /opt/stack/data/nova/instances/snapshots/tmpdqq_fdh6/608f98b1fbcc4400a2f318eb2d0eb850" returned: 0 in 0.381s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:44 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Snapshot extracted, beginning image upload
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Cannot resize image /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'migration_context' on Instance uuid 5fd40faf-6ffa-40ff-b437-dd82717d9489 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Ensure instance console log exists: /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Successfully created port: fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:44:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:45 user nova-compute[71654]: WARNING nova.compute.manager [req-3ec7266b-dfd0-4644-a09e-aca7bdebbd64 req-c954e2c9-2aa9-411c-9992-64c01ae23256 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Successfully updated port: fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquired lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-changed-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Refreshing instance network info cache due to event network-changed-fef0930e-d810-45b5-aecc-a933e3ef8d35. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Acquiring lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Updating instance_info_cache with network_info: [{"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Releasing lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Instance network_info: |[{"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Acquired lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Refreshing network info cache for port fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Start _get_guest_xml network_info=[{"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:46 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:46 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78834662',display_name='tempest-AttachVolumeNegativeTest-server-78834662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78834662',id=21,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADHO2g4Wxo5uFCOEdCVbkMLrFL9fP1gcWaAZRsI44Qk7/GCV2Jx9IoTZMmvhldVm5kgL8hr47CmfuErH7Fbg6zlJ3CQ3hyZ8RhmjcLlo4w+Vva9kQGnWHeqbhqqYAh62g==',key_name='tempest-keypair-1283781213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-9kefgks8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=5fd40faf-6ffa-40ff-b437-dd82717d9489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fd40faf-6ffa-40ff-b437-dd82717d9489 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:44:46 user nova-compute[71654]:   <uuid>5fd40faf-6ffa-40ff-b437-dd82717d9489</uuid>
Apr 11 20:44:46 user nova-compute[71654]:   <name>instance-00000015</name>
Apr 11 20:44:46 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:44:46 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:44:46 user nova-compute[71654]:   <metadata>
Apr 11 20:44:46 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:44:46 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:44:46 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeNegativeTest-server-78834662</nova:name>
Apr 11 20:44:46 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:44:46</nova:creationTime>
Apr 11 20:44:46 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:44:46 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:44:46 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:44:46 user nova-compute[71654]:       <nova:owner>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:user uuid="4f69b01612974865be4e1e1b6a9bd570">tempest-AttachVolumeNegativeTest-1901377641-project-member</nova:user>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:project uuid="db28134878ba46528b7d5012ff9c7aff">tempest-AttachVolumeNegativeTest-1901377641</nova:project>
Apr 11 20:44:46 user nova-compute[71654]:       </nova:owner>
Apr 11 20:44:46 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:44:46 user nova-compute[71654]:       <nova:ports>
Apr 11 20:44:46 user nova-compute[71654]:         <nova:port uuid="fef0930e-d810-45b5-aecc-a933e3ef8d35">
Apr 11 20:44:46 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 20:44:46 user nova-compute[71654]:         </nova:port>
Apr 11 20:44:46 user nova-compute[71654]:       </nova:ports>
Apr 11 20:44:46 user nova-compute[71654]:     </nova:instance>
Apr 11 20:44:46 user nova-compute[71654]:   </metadata>
Apr 11 20:44:46 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:44:46 user nova-compute[71654]:     <system>
Apr 11 20:44:46 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:44:46 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:44:46 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:44:46 user nova-compute[71654]:       <entry name="serial">5fd40faf-6ffa-40ff-b437-dd82717d9489</entry>
Apr 11 20:44:46 user nova-compute[71654]:       <entry name="uuid">5fd40faf-6ffa-40ff-b437-dd82717d9489</entry>
Apr 11 20:44:46 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:44:46 user nova-compute[71654]:     </system>
Apr 11 20:44:46 user nova-compute[71654]:   </sysinfo>
Apr 11 20:44:46 user nova-compute[71654]:   <os>
Apr 11 20:44:46 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:44:46 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:44:46 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:44:46 user nova-compute[71654]:   </os>
Apr 11 20:44:46 user nova-compute[71654]:   <features>
Apr 11 20:44:46 user nova-compute[71654]:     <acpi/>
Apr 11 20:44:46 user nova-compute[71654]:     <apic/>
Apr 11 20:44:46 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:44:46 user nova-compute[71654]:   </features>
Apr 11 20:44:46 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:44:46 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:44:46 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:44:46 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:44:46 user nova-compute[71654]:   </clock>
Apr 11 20:44:46 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:44:46 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:44:46 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:44:46 user nova-compute[71654]:   </cpu>
Apr 11 20:44:46 user nova-compute[71654]:   <devices>
Apr 11 20:44:46 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:46 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:46 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk"/>
Apr 11 20:44:46 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:44:46 user nova-compute[71654]:     </disk>
Apr 11 20:44:46 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:44:46 user nova-compute[71654]:       <mac address="fa:16:3e:93:3e:ed"/>
Apr 11 20:44:46 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:46 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:44:46 user nova-compute[71654]:       <target dev="tapfef0930e-d8"/>
Apr 11 20:44:46 user nova-compute[71654]:     </interface>
Apr 11 20:44:46 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:44:46 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/console.log" append="off"/>
Apr 11 20:44:46 user nova-compute[71654]:     </serial>
Apr 11 20:44:46 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:44:46 user nova-compute[71654]:     <video>
Apr 11 20:44:46 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:46 user nova-compute[71654]:     </video>
Apr 11 20:44:46 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:44:46 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:44:46 user nova-compute[71654]:     </rng>
Apr 11 20:44:46 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:44:46 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:44:46 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:44:46 user nova-compute[71654]:     </memballoon>
Apr 11 20:44:46 user nova-compute[71654]:   </devices>
Apr 11 20:44:46 user nova-compute[71654]: </domain>
Apr 11 20:44:46 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78834662',display_name='tempest-AttachVolumeNegativeTest-server-78834662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78834662',id=21,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADHO2g4Wxo5uFCOEdCVbkMLrFL9fP1gcWaAZRsI44Qk7/GCV2Jx9IoTZMmvhldVm5kgL8hr47CmfuErH7Fbg6zlJ3CQ3hyZ8RhmjcLlo4w+Vva9kQGnWHeqbhqqYAh62g==',key_name='tempest-keypair-1283781213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-9kefgks8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=5fd40faf-6ffa-40ff-b437-dd82717d9489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG os_vif [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfef0930e-d8, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfef0930e-d8, col_values=(('external_ids', {'iface-id': 'fef0930e-d810-45b5-aecc-a933e3ef8d35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:3e:ed', 'vm-uuid': '5fd40faf-6ffa-40ff-b437-dd82717d9489'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:46 user nova-compute[71654]: INFO os_vif [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8')
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:93:3e:ed, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Snapshot image upload complete
Apr 11 20:44:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:47 user nova-compute[71654]: INFO nova.compute.manager [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Shelve offloading
Apr 11 20:44:47 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance destroyed successfully.
Apr 11 20:44:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG nova.network.neutron [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG nova.network.neutron [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Updated VIF entry in instance network info cache for port fef0930e-d810-45b5-aecc-a933e3ef8d35. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG nova.network.neutron [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Updating instance_info_cache with network_info: [{"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a9f8bd6f-5254-4af2-942e-2013bdb36a9f req-90aa251c-bd4a-4481-875b-b2000a8e0199 service nova] Releasing lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG nova.network.neutron [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance destroyed successfully.
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'resources' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345208448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345208448',id=16,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXzG/+iyFuLq/UP2Nf5869PwPaIxZUHlcTfcaQgIRL9ghHbGCVYa9ZHifqpcdGOoDPU/AR9Vn/W3qYR1rkx0sBJJpcHf1bVwdR/Ko66Ttz3Mo82/6YMPmg7BC5ao/FyXQ==',key_name='tempest-keypair-545600492',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:42:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-voquowxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member',shelved_at='2023-04-11T20:44:46.947898',shelved_host='user',shelved_image_id='b77ab62b-227f-4a01-ad83-03df74883230'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=4ad985d5-6fd0-48f3-be8f-00a7fc4791c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG os_vif [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing instance network info cache due to event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.network.neutron [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70b946a4-09, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: INFO os_vif [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09')
Apr 11 20:44:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Deleting instance files /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4_del
Apr 11 20:44:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Deletion of /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4_del complete
Apr 11 20:44:48 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Deleted allocations for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4
Apr 11 20:44:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-809f7fa4-c6c0-4290-8c17-7f06c2cd822f tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.722s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:49 user nova-compute[71654]: DEBUG nova.network.neutron [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updated VIF entry in instance network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:44:49 user nova-compute[71654]: DEBUG nova.network.neutron [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap70b946a4-09", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4d3f71cd-52c1-475e-b25c-3d1b0cbd4a4b req-3ebf30e9-01cb-4412-bd2b-a0200cc017da service nova] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Rescuing
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] No waiting events found dispatching network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:50 user nova-compute[71654]: WARNING nova.compute.manager [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received unexpected event network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance with vm_state building and task_state spawning.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] No waiting events found dispatching network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:50 user nova-compute[71654]: WARNING nova.compute.manager [req-01e502d9-ff40-4b62-b7fe-1ad1f4455c41 req-dbff7996-ba5e-4a27-955d-d7a01ec09ea0 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received unexpected event network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance with vm_state building and task_state spawning.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245890.4847722, 5fd40faf-6ffa-40ff-b437-dd82717d9489 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] VM Resumed (Lifecycle Event)
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Instance spawned successfully.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245890.4874012, 5fd40faf-6ffa-40ff-b437-dd82717d9489 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] VM Started (Lifecycle Event)
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updating instance_info_cache with network_info: [{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Took 6.57 seconds to spawn the instance on the hypervisor.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:50 user nova-compute[71654]: INFO nova.compute.manager [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Took 7.48 seconds to build instance.
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fc389c19-bf5e-4367-b525-090a63ef7074 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.588s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:50 user nova-compute[71654]: WARNING nova.compute.manager [req-6710aa08-783e-4000-88d4-b79fd6e19a66 req-62eb6db5-9f03-4f70-b8f3-8457d7027ad5 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state active and task_state rescuing.
Apr 11 20:44:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance destroyed successfully.
Apr 11 20:44:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Attempting rescue
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71654) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:44:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Creating image(s)
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'trusted_certs' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue" returned: 0 in 0.250s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'migration_context' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Start _get_guest_xml network_info=[{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:83:1a:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'resources' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'numa_topology' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:51 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:51 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'vcpu_model' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-57617171',display_name='tempest-ServerRescueNegativeTestJSON-server-57617171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-57617171',id=18,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-d9rxhm4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:07Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=764a059b-9ded-4d53-b960-ced4abe4323d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:83:1a:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:83:1a:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'pci_devices' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:44:51 user nova-compute[71654]:   <uuid>764a059b-9ded-4d53-b960-ced4abe4323d</uuid>
Apr 11 20:44:51 user nova-compute[71654]:   <name>instance-00000012</name>
Apr 11 20:44:51 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:44:51 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:44:51 user nova-compute[71654]:   <metadata>
Apr 11 20:44:51 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:44:51 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:44:51 user nova-compute[71654]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-57617171</nova:name>
Apr 11 20:44:51 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:44:51</nova:creationTime>
Apr 11 20:44:51 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:44:51 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:44:51 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:44:51 user nova-compute[71654]:       <nova:owner>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:user uuid="dce0b6fa6d9546c8a04b7a4a5f93e0c7">tempest-ServerRescueNegativeTestJSON-777351805-project-member</nova:user>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:project uuid="a2ad2f73c14141dd8f7aa0d6f6c747b0">tempest-ServerRescueNegativeTestJSON-777351805</nova:project>
Apr 11 20:44:51 user nova-compute[71654]:       </nova:owner>
Apr 11 20:44:51 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:44:51 user nova-compute[71654]:       <nova:ports>
Apr 11 20:44:51 user nova-compute[71654]:         <nova:port uuid="4698b719-9a11-4eae-9a8d-d736723b13bb">
Apr 11 20:44:51 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 20:44:51 user nova-compute[71654]:         </nova:port>
Apr 11 20:44:51 user nova-compute[71654]:       </nova:ports>
Apr 11 20:44:51 user nova-compute[71654]:     </nova:instance>
Apr 11 20:44:51 user nova-compute[71654]:   </metadata>
Apr 11 20:44:51 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:44:51 user nova-compute[71654]:     <system>
Apr 11 20:44:51 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:44:51 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:44:51 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:44:51 user nova-compute[71654]:       <entry name="serial">764a059b-9ded-4d53-b960-ced4abe4323d</entry>
Apr 11 20:44:51 user nova-compute[71654]:       <entry name="uuid">764a059b-9ded-4d53-b960-ced4abe4323d</entry>
Apr 11 20:44:51 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:44:51 user nova-compute[71654]:     </system>
Apr 11 20:44:51 user nova-compute[71654]:   </sysinfo>
Apr 11 20:44:51 user nova-compute[71654]:   <os>
Apr 11 20:44:51 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:44:51 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:44:51 user nova-compute[71654]:   </os>
Apr 11 20:44:51 user nova-compute[71654]:   <features>
Apr 11 20:44:51 user nova-compute[71654]:     <acpi/>
Apr 11 20:44:51 user nova-compute[71654]:     <apic/>
Apr 11 20:44:51 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:44:51 user nova-compute[71654]:   </features>
Apr 11 20:44:51 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:44:51 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:44:51 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:44:51 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:44:51 user nova-compute[71654]:   </clock>
Apr 11 20:44:51 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:44:51 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:44:51 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:44:51 user nova-compute[71654]:   </cpu>
Apr 11 20:44:51 user nova-compute[71654]:   <devices>
Apr 11 20:44:51 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:51 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:51 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue"/>
Apr 11 20:44:51 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:44:51 user nova-compute[71654]:     </disk>
Apr 11 20:44:51 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:51 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:51 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk"/>
Apr 11 20:44:51 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:44:51 user nova-compute[71654]:     </disk>
Apr 11 20:44:51 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:44:51 user nova-compute[71654]:       <mac address="fa:16:3e:83:1a:7b"/>
Apr 11 20:44:51 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:51 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:44:51 user nova-compute[71654]:       <target dev="tap4698b719-9a"/>
Apr 11 20:44:51 user nova-compute[71654]:     </interface>
Apr 11 20:44:51 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:44:51 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/console.log" append="off"/>
Apr 11 20:44:51 user nova-compute[71654]:     </serial>
Apr 11 20:44:51 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:44:51 user nova-compute[71654]:     <video>
Apr 11 20:44:51 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:51 user nova-compute[71654]:     </video>
Apr 11 20:44:51 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:44:51 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:44:51 user nova-compute[71654]:     </rng>
Apr 11 20:44:51 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:44:51 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:44:51 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:44:51 user nova-compute[71654]:     </memballoon>
Apr 11 20:44:51 user nova-compute[71654]:   </devices>
Apr 11 20:44:51 user nova-compute[71654]: </domain>
Apr 11 20:44:51 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:44:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance destroyed successfully.
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:83:1a:7b, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:53 user nova-compute[71654]: WARNING nova.compute.manager [req-a6269755-4cf9-4d39-bdae-79996e636eaf req-935077ff-edea-4e3e-8cf8-719d4cae1831 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state active and task_state rescuing.
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:55 user nova-compute[71654]: WARNING nova.compute.manager [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state active and task_state rescuing.
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:44:55 user nova-compute[71654]: WARNING nova.compute.manager [req-242272a5-3be6-4059-aa46-3b5ddec632c5 req-cfee0fec-47ae-4366-bc0e-bc79b5085182 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state active and task_state rescuing.
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 764a059b-9ded-4d53-b960-ced4abe4323d due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245895.8054328, 764a059b-9ded-4d53-b960-ced4abe4323d => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] VM Resumed (Lifecycle Event)
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2b341ce3-4868-4d1c-a65a-c487e390078f tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245895.8067174, 764a059b-9ded-4d53-b960-ced4abe4323d => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] VM Started (Lifecycle Event)
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:44:56 user nova-compute[71654]: INFO nova.compute.claims [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Claim successful on node user
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:44:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.policy [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a70ed7ce13442e6b7f6f62b960520ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd62a4c803247588716e71c25c62b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:44:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Creating image(s)
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "/opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "/opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "e2e147aefcad7a694daeba1b7ff44596c3c31027" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "e2e147aefcad7a694daeba1b7ff44596c3c31027" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG nova.virt.images [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] d90454ee-0320-44ce-8994-3b5c9ecb8abb was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.part /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Successfully created port: 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.part /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.converted" returned: 0 in 0.283s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "e2e147aefcad7a694daeba1b7ff44596c3c31027" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.087s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027 --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "e2e147aefcad7a694daeba1b7ff44596c3c31027" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "e2e147aefcad7a694daeba1b7ff44596c3c31027" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027 --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027,backing_fmt=raw /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027,backing_fmt=raw /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk 1073741824" returned: 0 in 0.051s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "e2e147aefcad7a694daeba1b7ff44596c3c31027" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027 --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Successfully updated port: 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing instance network info cache due to event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Cannot resize image /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'migration_context' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Ensure instance console log exists: /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245883.8847966, 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:44:58 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] VM Stopped (Lifecycle Event)
Apr 11 20:44:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a67edf20-6cd1-4b4b-9538-604415ff6783 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance network_info: |[{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Start _get_guest_xml network_info=[{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:44:53Z,direct_url=<?>,disk_format='qcow2',id=d90454ee-0320-44ce-8994-3b5c9ecb8abb,min_disk=0,min_ram=0,name='tempest-scenario-img--701284014',owner='cdd62a4c803247588716e71c25c62b05',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:44:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd90454ee-0320-44ce-8994-3b5c9ecb8abb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:44:59 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:59 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:44:53Z,direct_url=<?>,disk_format='qcow2',id=d90454ee-0320-44ce-8994-3b5c9ecb8abb,min_disk=0,min_ram=0,name='tempest-scenario-img--701284014',owner='cdd62a4c803247588716e71c25c62b05',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:44:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-386756076',display_name='tempest-TestMinimumBasicScenario-server-386756076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-386756076',id=22,image_ref='d90454ee-0320-44ce-8994-3b5c9ecb8abb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgoaav2PRI5VZHoMp36RWFkGeyFgjBLkoPgkMM2Hm65e/3oSHCaUfGRxdpsPwOI/1U0NM4gRMKIb9KS0QfuAoBhUYfJpTYnlQ7qj7Mn/zb/HY5zoBAOJEN0G31zbRJyBg==',key_name='tempest-TestMinimumBasicScenario-1187350393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-1z6fv609',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d90454ee-0320-44ce-8994-3b5c9ecb8abb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:57Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=0d4bccf7-341f-4bc4-ade1-cb948f6dd950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:44:59 user nova-compute[71654]:   <uuid>0d4bccf7-341f-4bc4-ade1-cb948f6dd950</uuid>
Apr 11 20:44:59 user nova-compute[71654]:   <name>instance-00000016</name>
Apr 11 20:44:59 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:44:59 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:44:59 user nova-compute[71654]:   <metadata>
Apr 11 20:44:59 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:44:59 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:44:59 user nova-compute[71654]:       <nova:name>tempest-TestMinimumBasicScenario-server-386756076</nova:name>
Apr 11 20:44:59 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:44:59</nova:creationTime>
Apr 11 20:44:59 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:44:59 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:44:59 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:44:59 user nova-compute[71654]:       <nova:owner>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:user uuid="0a70ed7ce13442e6b7f6f62b960520ad">tempest-TestMinimumBasicScenario-2142191059-project-member</nova:user>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:project uuid="cdd62a4c803247588716e71c25c62b05">tempest-TestMinimumBasicScenario-2142191059</nova:project>
Apr 11 20:44:59 user nova-compute[71654]:       </nova:owner>
Apr 11 20:44:59 user nova-compute[71654]:       <nova:root type="image" uuid="d90454ee-0320-44ce-8994-3b5c9ecb8abb"/>
Apr 11 20:44:59 user nova-compute[71654]:       <nova:ports>
Apr 11 20:44:59 user nova-compute[71654]:         <nova:port uuid="91830629-fa39-4a76-9eba-4b33f2f66b7a">
Apr 11 20:44:59 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 20:44:59 user nova-compute[71654]:         </nova:port>
Apr 11 20:44:59 user nova-compute[71654]:       </nova:ports>
Apr 11 20:44:59 user nova-compute[71654]:     </nova:instance>
Apr 11 20:44:59 user nova-compute[71654]:   </metadata>
Apr 11 20:44:59 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:44:59 user nova-compute[71654]:     <system>
Apr 11 20:44:59 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:44:59 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:44:59 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:44:59 user nova-compute[71654]:       <entry name="serial">0d4bccf7-341f-4bc4-ade1-cb948f6dd950</entry>
Apr 11 20:44:59 user nova-compute[71654]:       <entry name="uuid">0d4bccf7-341f-4bc4-ade1-cb948f6dd950</entry>
Apr 11 20:44:59 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:44:59 user nova-compute[71654]:     </system>
Apr 11 20:44:59 user nova-compute[71654]:   </sysinfo>
Apr 11 20:44:59 user nova-compute[71654]:   <os>
Apr 11 20:44:59 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:44:59 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:44:59 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:44:59 user nova-compute[71654]:   </os>
Apr 11 20:44:59 user nova-compute[71654]:   <features>
Apr 11 20:44:59 user nova-compute[71654]:     <acpi/>
Apr 11 20:44:59 user nova-compute[71654]:     <apic/>
Apr 11 20:44:59 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:44:59 user nova-compute[71654]:   </features>
Apr 11 20:44:59 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:44:59 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:44:59 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:44:59 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:44:59 user nova-compute[71654]:   </clock>
Apr 11 20:44:59 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:44:59 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:44:59 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:44:59 user nova-compute[71654]:   </cpu>
Apr 11 20:44:59 user nova-compute[71654]:   <devices>
Apr 11 20:44:59 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:44:59 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:44:59 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk"/>
Apr 11 20:44:59 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:44:59 user nova-compute[71654]:     </disk>
Apr 11 20:44:59 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:44:59 user nova-compute[71654]:       <mac address="fa:16:3e:42:3b:00"/>
Apr 11 20:44:59 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:59 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:44:59 user nova-compute[71654]:       <target dev="tap91830629-fa"/>
Apr 11 20:44:59 user nova-compute[71654]:     </interface>
Apr 11 20:44:59 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:44:59 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/console.log" append="off"/>
Apr 11 20:44:59 user nova-compute[71654]:     </serial>
Apr 11 20:44:59 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:44:59 user nova-compute[71654]:     <video>
Apr 11 20:44:59 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:44:59 user nova-compute[71654]:     </video>
Apr 11 20:44:59 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:44:59 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:44:59 user nova-compute[71654]:     </rng>
Apr 11 20:44:59 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:44:59 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:44:59 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:44:59 user nova-compute[71654]:     </memballoon>
Apr 11 20:44:59 user nova-compute[71654]:   </devices>
Apr 11 20:44:59 user nova-compute[71654]: </domain>
Apr 11 20:44:59 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-386756076',display_name='tempest-TestMinimumBasicScenario-server-386756076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-386756076',id=22,image_ref='d90454ee-0320-44ce-8994-3b5c9ecb8abb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgoaav2PRI5VZHoMp36RWFkGeyFgjBLkoPgkMM2Hm65e/3oSHCaUfGRxdpsPwOI/1U0NM4gRMKIb9KS0QfuAoBhUYfJpTYnlQ7qj7Mn/zb/HY5zoBAOJEN0G31zbRJyBg==',key_name='tempest-TestMinimumBasicScenario-1187350393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-1z6fv609',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d90454ee-0320-44ce-8994-3b5c9ecb8abb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:44:57Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=0d4bccf7-341f-4bc4-ade1-cb948f6dd950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG os_vif [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91830629-fa, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91830629-fa, col_values=(('external_ids', {'iface-id': '91830629-fa39-4a76-9eba-4b33f2f66b7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:3b:00', 'vm-uuid': '0d4bccf7-341f-4bc4-ade1-cb948f6dd950'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:44:59 user nova-compute[71654]: INFO os_vif [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa')
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No VIF found with MAC fa:16:3e:42:3b:00, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updated VIF entry in instance network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:44:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-746d72f0-af11-44ef-a91d-63d0be3ee9de req-96d25f29-9e4b-45d6-8c88-649800a806c0 service nova] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:45:00 user nova-compute[71654]: INFO nova.compute.manager [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Rescuing
Apr 11 20:45:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:45:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:45:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:45:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:45:01 user nova-compute[71654]: WARNING nova.compute.manager [req-92479ed1-9629-4417-81da-3c68d21652dc req-720aed37-6cda-4460-9012-2d3a46b9b708 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state building and task_state spawning.
Apr 11 20:45:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance destroyed successfully.
Apr 11 20:45:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Attempting a stable device rescue
Apr 11 20:45:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71654) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:45:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Creating image(s)
Apr 11 20:45:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "/opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'trusted_certs' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "c76c4b9d982c0137aed8e0d5e5009ca963398d1f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "c76c4b9d982c0137aed8e0d5e5009ca963398d1f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245903.0841928, 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] VM Resumed (Lifecycle Event)
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.images [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 5891e9c1-e817-4a4a-8c05-89f0840fc343 was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.part /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance spawned successfully.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245903.098602, 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] VM Started (Lifecycle Event)
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:45:03 user nova-compute[71654]: WARNING nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state building and task_state spawning.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:45:03 user nova-compute[71654]: WARNING nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state active and task_state rescuing.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:45:03 user nova-compute[71654]: WARNING nova.compute.manager [req-b391bad9-20e1-45dc-8435-57e118a8cc59 req-6910a5ca-c4c3-4790-b2c1-c6d0d7d4c18c service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state active and task_state rescuing.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Took 6.87 seconds to spawn the instance on the hypervisor.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.part /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.converted" returned: 0 in 0.614s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:03 user nova-compute[71654]: INFO nova.compute.manager [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Took 7.73 seconds to build instance.
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ea93c480-5d7f-45d1-96e6-881542992ef1 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.830s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "c76c4b9d982c0137aed8e0d5e5009ca963398d1f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.698s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "c76c4b9d982c0137aed8e0d5e5009ca963398d1f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "c76c4b9d982c0137aed8e0d5e5009ca963398d1f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f,backing_fmt=raw /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f,backing_fmt=raw /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue" returned: 0 in 0.056s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "c76c4b9d982c0137aed8e0d5e5009ca963398d1f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'migration_context' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Start _get_guest_xml network_info=[{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "vif_mac": "fa:16:3e:11:00:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5891e9c1-e817-4a4a-8c05-89f0840fc343', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '097d9483-07ea-4dce-afd6-4d28dd0d2390', 'attached_at': '', 'detached_at': '', 'volume_id': '625f97cf-09c8-456b-92ae-a757e4e74f3b', 'serial': '625f97cf-09c8-456b-92ae-a757e4e74f3b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'de60948b-ca22-4d4e-a24f-0bed8f59cbd4', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'resources' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'numa_topology' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:45:04 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:45:04 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'vcpu_model' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:45:04 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:45:04 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:45:04 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[65106b59-c8e4-40ab-a9d5-ab09960573b3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nkfhbGRe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 20:45:04 user nova-compute[71654]: node.name = iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:45:04 user nova-compute[71654]: node.tpgt = -1
Apr 11 20:45:04 user nova-compute[71654]: node.startup = automatic
Apr 11 20:45:04 user nova-compute[71654]: node.leading_login = No
Apr 11 20:45:04 user nova-compute[71654]: iface.iscsi_ifacename = default
Apr 11 20:45:04 user nova-compute[71654]: iface.net_ifacename = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.ipaddress = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.prefix_len = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.hwaddress = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.transport_name = tcp
Apr 11 20:45:04 user nova-compute[71654]: iface.initiatorname = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.vlan_id = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.vlan_priority = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.vlan_state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.iface_num = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.mtu = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.port = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.bootproto = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.subnet_mask = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.gateway = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_alt_client_id = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_dns = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_learn_iqn = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_vendor_id_state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_vendor_id = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.dhcp_slp_da = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.fragmentation = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.gratuitous_arp = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.incoming_forwarding = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.tos_state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.tos = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.ttl = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.delayed_ack = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.tcp_nagle = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.tcp_wsf_state = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.tcp_wsf = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.tcp_timer_scale = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.tcp_timestamp = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.redirect = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.def_task_mgmt_timeout = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.header_digest = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.data_digest = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.immediate_data = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.initial_r2t = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.data_seq_inorder = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.data_pdu_inorder = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.erl = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.max_receive_data_len = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.first_burst_len = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.max_outstanding_r2t = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.max_burst_len = 0
Apr 11 20:45:04 user nova-compute[71654]: iface.chap_auth = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.bidi_chap = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.strict_login_compliance = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.discovery_auth = <empty>
Apr 11 20:45:04 user nova-compute[71654]: iface.discovery_logout = <empty>
Apr 11 20:45:04 user nova-compute[71654]: node.discovery_address = <empty>
Apr 11 20:45:04 user nova-compute[71654]: node.discovery_port = 0
Apr 11 20:45:04 user nova-compute[71654]: node.discovery_type = static
Apr 11 20:45:04 user nova-compute[71654]: node.session.initial_cmdsn = 0
Apr 11 20:45:04 user nova-compute[71654]: node.session.initial_login_retry_max = 8
Apr 11 20:45:04 user nova-compute[71654]: node.session.xmit_thread_priority = -20
Apr 11 20:45:04 user nova-compute[71654]: node.session.cmds_max = 128
Apr 11 20:45:04 user nova-compute[71654]: node.session.queue_depth = 32
Apr 11 20:45:04 user nova-compute[71654]: node.session.nr_sessions = 1
Apr 11 20:45:04 user nova-compute[71654]: node.session.auth.authmethod = CHAP
Apr 11 20:45:04 user nova-compute[71654]: node.session.auth.username = nkfhbGRe
Apr 11 20:45:04 user nova-compute[71654]: node.session.auth.password = ***
Apr 11 20:45:04 user nova-compute[71654]: node.session.auth.username_in = <empty>
Apr 11 20:45:04 user nova-compute[71654]: node.session.auth.password_in = <empty>
Apr 11 20:45:04 user nova-compute[71654]: node.session.auth.chap_algs = MD5
Apr 11 20:45:04 user nova-compute[71654]: node.session.timeo.replacement_timeout = 120
Apr 11 20:45:04 user nova-compute[71654]: node.session.err_timeo.abort_timeout = 15
Apr 11 20:45:04 user nova-compute[71654]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 20:45:04 user nova-compute[71654]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 20:45:04 user nova-compute[71654]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.FastAbort = Yes
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.InitialR2T = No
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.ImmediateData = Yes
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.MaxConnections = 1
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 20:45:04 user nova-compute[71654]: node.session.iscsi.ERL = 0
Apr 11 20:45:04 user nova-compute[71654]: node.session.scan = manual
Apr 11 20:45:04 user nova-compute[71654]: node.session.reopen_max = 0
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].address = 172.16.0.220
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].port = 3260
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].startup = manual
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].tcp.window_size = 524288
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].tcp.type_of_service = 0
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].timeo.logout_timeout = 15
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].timeo.login_timeout = 15
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].timeo.auth_timeout = 45
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].iscsi.DataDigest = None
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].iscsi.IFMarker = No
Apr 11 20:45:04 user nova-compute[71654]: node.conn[0].iscsi.OFMarker = No
Apr 11 20:45:04 user nova-compute[71654]: # END RECORD
Apr 11 20:45:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d84650d-c761-4dfd-8f93-08efb9283519]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2ea85-97f8-4958-a4da-88e0cff86c6a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkfhbGRe {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkfhbGRe" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91031b9-1155-41ce-9c5e-aa2aff240939]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkfhbGRe'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec61c74-de15-437e-b60a-21668ba0d34f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c5c0eb-7115-46eb-bc88-f104824ca26d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:45:04 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:45:04 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:45:04 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:45:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:45:04 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:45:04 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:45:04 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:45:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7701ec22-0c8e-4054-bca5-195609f4214f]: (4, ('0 0 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23962626462633535', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962626462633535', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-565746598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-565746598',id=19,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:43:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-pepmmnwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:26Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=097d9483-07ea-4dce-afd6-4d28dd0d2390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "vif_mac": "fa:16:3e:11:00:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "vif_mac": "fa:16:3e:11:00:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'pci_devices' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:45:04 user nova-compute[71654]:   <uuid>097d9483-07ea-4dce-afd6-4d28dd0d2390</uuid>
Apr 11 20:45:04 user nova-compute[71654]:   <name>instance-00000013</name>
Apr 11 20:45:04 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:45:04 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:45:04 user nova-compute[71654]:   <metadata>
Apr 11 20:45:04 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:45:04 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:45:04 user nova-compute[71654]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-565746598</nova:name>
Apr 11 20:45:04 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:45:04</nova:creationTime>
Apr 11 20:45:04 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:45:04 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:45:04 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:45:04 user nova-compute[71654]:       <nova:owner>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:user uuid="1d5cb62cc3844248be2e4456d970ccdf">tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member</nova:user>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:project uuid="85bf8fe34838426ea05060463458e5e0">tempest-ServerBootFromVolumeStableRescueTest-243239500</nova:project>
Apr 11 20:45:04 user nova-compute[71654]:       </nova:owner>
Apr 11 20:45:04 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:45:04 user nova-compute[71654]:       <nova:ports>
Apr 11 20:45:04 user nova-compute[71654]:         <nova:port uuid="4d88bcd7-9de8-4278-9490-d4c866efebc4">
Apr 11 20:45:04 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:45:04 user nova-compute[71654]:         </nova:port>
Apr 11 20:45:04 user nova-compute[71654]:       </nova:ports>
Apr 11 20:45:04 user nova-compute[71654]:     </nova:instance>
Apr 11 20:45:04 user nova-compute[71654]:   </metadata>
Apr 11 20:45:04 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:45:04 user nova-compute[71654]:     <system>
Apr 11 20:45:04 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:45:04 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:45:04 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:45:04 user nova-compute[71654]:       <entry name="serial">097d9483-07ea-4dce-afd6-4d28dd0d2390</entry>
Apr 11 20:45:04 user nova-compute[71654]:       <entry name="uuid">097d9483-07ea-4dce-afd6-4d28dd0d2390</entry>
Apr 11 20:45:04 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:45:04 user nova-compute[71654]:     </system>
Apr 11 20:45:04 user nova-compute[71654]:   </sysinfo>
Apr 11 20:45:04 user nova-compute[71654]:   <os>
Apr 11 20:45:04 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:45:04 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:45:04 user nova-compute[71654]:   </os>
Apr 11 20:45:04 user nova-compute[71654]:   <features>
Apr 11 20:45:04 user nova-compute[71654]:     <acpi/>
Apr 11 20:45:04 user nova-compute[71654]:     <apic/>
Apr 11 20:45:04 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:45:04 user nova-compute[71654]:   </features>
Apr 11 20:45:04 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:45:04 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:45:04 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:45:04 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:45:04 user nova-compute[71654]:   </clock>
Apr 11 20:45:04 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:45:04 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:45:04 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:45:04 user nova-compute[71654]:   </cpu>
Apr 11 20:45:04 user nova-compute[71654]:   <devices>
Apr 11 20:45:04 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:45:04 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:45:04 user nova-compute[71654]:       <source dev="/dev/sdc"/>
Apr 11 20:45:04 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:45:04 user nova-compute[71654]:       <serial>625f97cf-09c8-456b-92ae-a757e4e74f3b</serial>
Apr 11 20:45:04 user nova-compute[71654]:     </disk>
Apr 11 20:45:04 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:45:04 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:45:04 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue"/>
Apr 11 20:45:04 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:45:04 user nova-compute[71654]:       <boot order="1"/>
Apr 11 20:45:04 user nova-compute[71654]:     </disk>
Apr 11 20:45:04 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:45:04 user nova-compute[71654]:       <mac address="fa:16:3e:11:00:a4"/>
Apr 11 20:45:04 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:45:04 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:45:04 user nova-compute[71654]:       <target dev="tap4d88bcd7-9d"/>
Apr 11 20:45:04 user nova-compute[71654]:     </interface>
Apr 11 20:45:04 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:45:04 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/console.log" append="off"/>
Apr 11 20:45:04 user nova-compute[71654]:     </serial>
Apr 11 20:45:04 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:45:04 user nova-compute[71654]:     <video>
Apr 11 20:45:04 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:45:04 user nova-compute[71654]:     </video>
Apr 11 20:45:04 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:45:04 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:45:04 user nova-compute[71654]:     </rng>
Apr 11 20:45:04 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:45:04 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:45:04 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:45:04 user nova-compute[71654]:     </memballoon>
Apr 11 20:45:04 user nova-compute[71654]:   </devices>
Apr 11 20:45:04 user nova-compute[71654]: </domain>
Apr 11 20:45:04 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:45:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance destroyed successfully.
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:45:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No VIF found with MAC fa:16:3e:11:00:a4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:45:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:45:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:45:06 user nova-compute[71654]: WARNING nova.compute.manager [req-489682d1-760f-4dca-a15a-46430dce1280 req-3f1219d3-ba18-4c3b-9761-d7658715df1f service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state active and task_state rescuing.
Apr 11 20:45:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:45:08 user nova-compute[71654]: WARNING nova.compute.manager [req-748d0e2c-2e4b-4ba0-bf7c-e75b0da45571 req-3d9c3752-361c-46c5-ad17-6d62815066f4 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state active and task_state rescuing.
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 097d9483-07ea-4dce-afd6-4d28dd0d2390 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245908.4883559, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:45:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Resumed (Lifecycle Event)
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e9647e65-fdc3-475b-ade6-c1c98c10ab3d tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:45:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245908.492209, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:45:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Started (Lifecycle Event)
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:45:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:45:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:15 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:45:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:18 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:45:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:45:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:45:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=26.25997543334961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:45:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Applying migration context for instance dadac585-3a7c-40d8-a335-fc2603588c28 as it has an incoming, in-progress migration 6672ac3a-0050-4d08-9611-9cee52d50588. Migration status is finished {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 20:45:23 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating resource usage from migration 6672ac3a-0050-4d08-9611-9cee52d50588
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Migration 6672ac3a-0050-4d08-9611-9cee52d50588 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:45:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:45:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:45:25 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:45:26 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:45:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:45:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:45:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:45:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:45:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:01 user nova-compute[71654]: INFO nova.compute.manager [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Detaching volume 042389e0-da53-4582-ae52-c57ba7f3c396
Apr 11 20:46:01 user nova-compute[71654]: INFO nova.virt.block_device [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Attempting to driver detach volume 042389e0-da53-4582-ae52-c57ba7f3c396 from mountpoint /dev/vdb
Apr 11 20:46:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Attempting to detach device vdb from instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:46:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:46:01 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:01 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:46:01 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:46:01 user nova-compute[71654]:   <serial>042389e0-da53-4582-ae52-c57ba7f3c396</serial>
Apr 11 20:46:01 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:46:01 user nova-compute[71654]: </disk>
Apr 11 20:46:01 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:46:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully detached device vdb from instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 from the persistent domain config.
Apr 11 20:46:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:46:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:46:01 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:01 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:46:01 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:46:01 user nova-compute[71654]:   <serial>042389e0-da53-4582-ae52-c57ba7f3c396</serial>
Apr 11 20:46:01 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 20:46:01 user nova-compute[71654]: </disk>
Apr 11 20:46:01 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:46:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245962.1562407, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:46:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully detached device vdb from instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 from the live domain config.
Apr 11 20:46:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZiKRfdeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:02 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b06fbd-9771-47c4-a439-cfc3a219f485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:46:02 user nova-compute[71654]: No targets found.
Apr 11 20:46:02 user nova-compute[71654]: iSNS:
Apr 11 20:46:02 user nova-compute[71654]: No targets found.
Apr 11 20:46:02 user nova-compute[71654]: STATIC:
Apr 11 20:46:02 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:46:02 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:02 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:02 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396
Apr 11 20:46:02 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:02 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:02 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c
Apr 11 20:46:02 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:02 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:02 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:46:02 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:02 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:02 user nova-compute[71654]: FIRMWARE:
Apr 11 20:46:02 user nova-compute[71654]: No targets found.
Apr 11 20:46:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:46:02 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:46:02 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de25608-91fe-43fb-a07c-2de185d8f687]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b7f63-d7d5-4d71-9d46-a2c5666e8ed7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:02 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:46:02 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:02 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:02 user nova-compute[71654]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 (non-flash)
Apr 11 20:46:02 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:02 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb403fb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb372bf-1570-4ae4-aeff-802ea0f68014]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fbedb6-8694-4cb5-abbd-b3276f5cd4b2]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd980ddc-304d-42bd-8643-d975d1e043b0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d5af8-7bae-4129-a634-385713104ce6]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6378e8-5b2e-4f4d-8354-bd98046d8595]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[641abb60-e460-4c45-8c13-5fee7eedc658]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260]
Apr 11 20:46:02 user nova-compute[71654]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396, portal: 172.16.0.220,3260] successful.
Apr 11 20:46:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042389e0-da53-4582-ae52-c57ba7f3c396 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7ccbae-1b7b-4489-a294-cc261632f677]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== disconnect_volume: return (310ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d079ca51-069c-4640-83c9-878eff48b53b tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.806s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Port 21864ca9-0ae0-4591-a5bc-fac2428743cb binding to destination host user is already ACTIVE {{(pid=71654) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71654) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Creating tmpfile /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/tmpgn4e4ozd to verify with other compute node that the instance is on the same shared storage. {{(pid=71654) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:04 user nova-compute[71654]: WARNING nova.compute.manager [req-1c01afd7-4b81-4173-b396-77e4daf46f7f req-80afcc90-12a3-42c5-8836-64302aa5611b service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state active and task_state powering-off.
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:04 user nova-compute[71654]: WARNING nova.compute.manager [req-bc492c10-95ed-43ee-92f3-c9a45af07e2c req-36de2d51-cd72-4304-86fe-461ff84a1584 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state resized and task_state resize_reverting.
Apr 11 20:46:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance destroyed successfully.
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:04 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance destroyed successfully.
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG os_vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c2824956-abe5-4bed-ad19-e83fe3c73303 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.157s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21864ca9-0a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:05 user nova-compute[71654]: INFO os_vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:46:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:05 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda01cda-c5c0-4f28-b470-5d5a052c434e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:46:05 user nova-compute[71654]: No targets found.
Apr 11 20:46:05 user nova-compute[71654]: iSNS:
Apr 11 20:46:05 user nova-compute[71654]: No targets found.
Apr 11 20:46:05 user nova-compute[71654]: STATIC:
Apr 11 20:46:05 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:46:05 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:05 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:05 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c
Apr 11 20:46:05 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:05 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:05 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:46:05 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:05 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:05 user nova-compute[71654]: FIRMWARE:
Apr 11 20:46:05 user nova-compute[71654]: No targets found.
Apr 11 20:46:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:46:05 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:46:05 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb019a-ecdc-4129-868c-c2469712b033]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047fb8b-f7b2-4b3c-80e4-43db41360e08]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:05 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:05 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:05 user nova-compute[71654]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:05 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb40741e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d818aac8-2666-4a1d-b725-2e3a51b1cf6d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaf9766-463e-4d39-806d-dcd9e4a1992b]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[842bb33e-1c43-48b4-aeb5-9b70a377e234]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e43e89e-29c6-4035-a253-7d401c0522a1]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a782754-d9c4-4dd6-9a18-3b5f9264817e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cb0b9-8dfd-4776-97b7-17b45414d031]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]
Apr 11 20:46:05 user nova-compute[71654]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.
Apr 11 20:46:05 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb8cdc2-f2a1-453b-83ee-bc528fb63711]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (297ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.objects.instance [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'migration_context' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:06 user nova-compute[71654]: WARNING nova.compute.manager [req-712818a7-f9fa-4ac4-9c12-d535acce7a4e req-cc24b967-35e9-4a55-80e4-cf2cb3fca1f2 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state stopped and task_state None.
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.410s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:06 user nova-compute[71654]: WARNING nova.compute.manager [req-676893c0-1575-4e97-ba70-46a005f7fff2 req-1784af6a-32a9-47c7-9072-c0ec0a761f15 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state resized and task_state resize_reverting.
Apr 11 20:46:06 user nova-compute[71654]: INFO nova.compute.manager [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Swapping old allocation on dict_keys(['da3f0379-92b3-4d28-8352-8945321a69cc']) held by migration 6672ac3a-0050-4d08-9611-9cee52d50588 for instance
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Overwriting current allocation {'allocations': {'da3f0379-92b3-4d28-8352-8945321a69cc': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 27}}, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'user_id': '7736d32586e949e4839f826f18994a0f', 'consumer_generation': 1} on consumer dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:06 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG os_brick.utils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d91ab-853e-40ee-a15a-0bfd8322faa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba20e16-baf3-476a-b0af-0e80af4c86d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f314bca6-f996-44dc-968d-28b80915299a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6360d-a1f4-4d93-8116-bf924684c541]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:46:07 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:46:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846ac39-a09f-4f6e-87ee-94af26d79121]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:46:07 user nova-compute[71654]: DEBUG os_brick.utils [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:10 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Starting finish_revert_migration {{(pid=71654) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start _get_guest_xml network_info=[{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dadac585-3a7c-40d8-a335-fc2603588c28', 'attached_at': '2023-04-11T20:46:12.000000', 'detached_at': '', 'volume_id': 'cfcd112c-1532-4aa6-9cc4-b03448a34609', 'serial': 'cfcd112c-1532-4aa6-9cc4-b03448a34609'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '21090d11-3cf9-42b3-a517-b40ae53e55d9', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:46:11 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:46:11 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'vcpu_model' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:11 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c995c-2683-40b8-a38a-0336d8bbc75d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:46:11 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a84f4a-9700-4055-a525-c1adcd800811]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609] added
Apr 11 20:46:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[da904e93-fc71-4fbc-8b64-342fc63c58ab]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[775c9d3e-b17d-4793-92e3-3c0663bdeba8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYsMFtAH {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYsMFtAH" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda90563-0c61-43c4-ac92-eb6c46ab9e73]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYsMFtAH'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec547268-0044-49a7-b2a8-4066bf76c28b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9feb0-2344-40f1-b779-e281026703de]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:11 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:11 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dfff7b-a3e5-40c1-822f-1d8555c94280]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]
Apr 11 20:46:11 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.
Apr 11 20:46:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[967f0cc7-8f15-409c-9313-17625847fdca]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bd228f-7695-43fe-b8c3-06e74f80b2de]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:12 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:12 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:12 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:12 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[820cae5d-9bf9-4632-86e8-6ab19e2ebcb5]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:12 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23832363261643230', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832363261643230', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:46:13 user nova-compute[71654]:   <uuid>dadac585-3a7c-40d8-a335-fc2603588c28</uuid>
Apr 11 20:46:13 user nova-compute[71654]:   <name>instance-00000003</name>
Apr 11 20:46:13 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:46:13 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:46:13 user nova-compute[71654]:   <metadata>
Apr 11 20:46:13 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:46:13 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:46:13 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-1788631209</nova:name>
Apr 11 20:46:13 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:46:11</nova:creationTime>
Apr 11 20:46:13 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:46:13 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:46:13 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:46:13 user nova-compute[71654]:       <nova:owner>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:46:13 user nova-compute[71654]:       </nova:owner>
Apr 11 20:46:13 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:46:13 user nova-compute[71654]:       <nova:ports>
Apr 11 20:46:13 user nova-compute[71654]:         <nova:port uuid="21864ca9-0ae0-4591-a5bc-fac2428743cb">
Apr 11 20:46:13 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:46:13 user nova-compute[71654]:         </nova:port>
Apr 11 20:46:13 user nova-compute[71654]:       </nova:ports>
Apr 11 20:46:13 user nova-compute[71654]:     </nova:instance>
Apr 11 20:46:13 user nova-compute[71654]:   </metadata>
Apr 11 20:46:13 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:46:13 user nova-compute[71654]:     <system>
Apr 11 20:46:13 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:46:13 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:46:13 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:46:13 user nova-compute[71654]:       <entry name="serial">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:46:13 user nova-compute[71654]:       <entry name="uuid">dadac585-3a7c-40d8-a335-fc2603588c28</entry>
Apr 11 20:46:13 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:46:13 user nova-compute[71654]:     </system>
Apr 11 20:46:13 user nova-compute[71654]:   </sysinfo>
Apr 11 20:46:13 user nova-compute[71654]:   <os>
Apr 11 20:46:13 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:46:13 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:46:13 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:46:13 user nova-compute[71654]:   </os>
Apr 11 20:46:13 user nova-compute[71654]:   <features>
Apr 11 20:46:13 user nova-compute[71654]:     <acpi/>
Apr 11 20:46:13 user nova-compute[71654]:     <apic/>
Apr 11 20:46:13 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:46:13 user nova-compute[71654]:   </features>
Apr 11 20:46:13 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:46:13 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:46:13 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:46:13 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:46:13 user nova-compute[71654]:   </clock>
Apr 11 20:46:13 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:46:13 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:46:13 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:46:13 user nova-compute[71654]:   </cpu>
Apr 11 20:46:13 user nova-compute[71654]:   <devices>
Apr 11 20:46:13 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:46:13 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:46:13 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk"/>
Apr 11 20:46:13 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:46:13 user nova-compute[71654]:     </disk>
Apr 11 20:46:13 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:46:13 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:13 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:46:13 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:46:13 user nova-compute[71654]:       <serial>cfcd112c-1532-4aa6-9cc4-b03448a34609</serial>
Apr 11 20:46:13 user nova-compute[71654]:     </disk>
Apr 11 20:46:13 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:46:13 user nova-compute[71654]:       <mac address="fa:16:3e:76:b1:a7"/>
Apr 11 20:46:13 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:46:13 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:46:13 user nova-compute[71654]:       <target dev="tap21864ca9-0a"/>
Apr 11 20:46:13 user nova-compute[71654]:     </interface>
Apr 11 20:46:13 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:46:13 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/console.log" append="off"/>
Apr 11 20:46:13 user nova-compute[71654]:     </serial>
Apr 11 20:46:13 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:46:13 user nova-compute[71654]:     <video>
Apr 11 20:46:13 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:46:13 user nova-compute[71654]:     </video>
Apr 11 20:46:13 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:46:13 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:46:13 user nova-compute[71654]:     </rng>
Apr 11 20:46:13 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:46:13 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:46:13 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:46:13 user nova-compute[71654]:     </memballoon>
Apr 11 20:46:13 user nova-compute[71654]:   </devices>
Apr 11 20:46:13 user nova-compute[71654]: </domain>
Apr 11 20:46:13 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG os_vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21864ca9-0a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21864ca9-0a, col_values=(('external_ids', {'iface-id': '21864ca9-0ae0-4591-a5bc-fac2428743cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b1:a7', 'vm-uuid': 'dadac585-3a7c-40d8-a335-fc2603588c28'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:46:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:13 user nova-compute[71654]: INFO os_vif [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:46:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:14 user nova-compute[71654]: WARNING nova.compute.manager [req-3b61371c-1ebf-4b03-93b2-c25953712a53 req-c7be92ef-46c3-4f98-8f4f-419c547a7bb9 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state resized and task_state resize_reverting.
Apr 11 20:46:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:15 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for dadac585-3a7c-40d8-a335-fc2603588c28 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245976.5571606, dadac585-3a7c-40d8-a335-fc2603588c28 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:16 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Resumed (Lifecycle Event)
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:46:16 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance running successfully.
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] finish_revert_migration finished successfully. {{(pid=71654) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:16 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681245976.55879, dadac585-3a7c-40d8-a335-fc2603588c28 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:16 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Started (Lifecycle Event)
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:16 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:16 user nova-compute[71654]: WARNING nova.compute.manager [req-e28c7a78-69bf-46f6-8f56-28faf6684cf6 req-7eea6120-74ed-4906-b367-ea584b79a34d service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state resized and task_state resize_reverting.
Apr 11 20:46:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:16 user nova-compute[71654]: INFO nova.compute.manager [None req-fb3712d0-c793-46a1-a0cc-046969cd5aeb tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance to original state: 'active'
Apr 11 20:46:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:46:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:19 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245964.9136758, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:19 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Stopped (Lifecycle Event)
Apr 11 20:46:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-87037acc-2174-4e48-a835-588b2311927c None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-87037acc-2174-4e48-a835-588b2311927c None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 20:46:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'flavor' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Ignoring supplied device name: /dev/vdb
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:20 user nova-compute[71654]: INFO nova.compute.manager [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Attaching volume 1685129d-095f-4ce2-993a-cea1173d30cb to /dev/vdb
Apr 11 20:46:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[34401287-a0a9-4cd0-b806-a46e987f728a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6584d2-204e-4851-ad55-d53472b63119]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee5096-5643-47e7-a264-e16d989ca31f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7ac45-5348-430a-b4dc-e3d11b4e6aa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:46:20 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a1557-b96f-4b03-9f0e-3d6485b71452]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Updating existing volume attachment record: 5d3f4bdd-36dd-4d4d-8105-cbaea336a315 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:20 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:46:25 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=26.27682876586914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuJADKaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:25 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:25 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:25 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c64032-803d-4513-8304-cfff8d5d4af3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:46:25 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b86854c-6840-48a5-9852-98f69091ad72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb] added
Apr 11 20:46:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[befed7f6-0635-41df-96a9-c03b067f5ac7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47fb3ab-479d-4eba-8562-ff682ccb0227]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuJADKaG {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuJADKaG" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebfe7d2-b31d-4546-9127-230a87999212]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RuJADKaG'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5fd40faf-6ffa-40ff-b437-dd82717d9489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[57838847-b73b-4b07-9ede-28726b807ef8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430f571-5be0-480c-b8f1-3d88dce99378]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8ff154-59c4-4da3-bc4c-9106267d351d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260]
Apr 11 20:46:25 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260] successful.
Apr 11 20:46:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fe3e99-b90a-444f-93f2-e1ff3b3fd865]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0117940d-3f1b-4688-bdec-3fabdfa47c6a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb (non-flash)
Apr 11 20:46:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:25 user nova-compute[71654]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb (non-flash)
Apr 11 20:46:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da56da4-fa1c-4659-a182-8998edbcda49]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuJADKaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:46:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23730333332316161', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730333332316161', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'flavor' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:46:26 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:26 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:46:26 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:46:26 user nova-compute[71654]:   <serial>1685129d-095f-4ce2-993a-cea1173d30cb</serial>
Apr 11 20:46:26 user nova-compute[71654]: </disk>
Apr 11 20:46:26 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No VIF found with MAC fa:16:3e:db:e5:5a, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ae959901-9692-4de8-a313-6a90391a506b tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.635s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:27 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [{"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-dadac585-3a7c-40d8-a335-fc2603588c28" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:46:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:46:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:46:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 20:46:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-changed-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Refreshing instance network info cache due to event network-changed-fef0930e-d810-45b5-aecc-a933e3ef8d35. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Acquiring lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Acquired lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Refreshing network info cache for port fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:34 user nova-compute[71654]: INFO nova.compute.manager [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Terminating instance
Apr 11 20:46:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:46:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.network.neutron [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Updated VIF entry in instance network info cache for port fef0930e-d810-45b5-aecc-a933e3ef8d35. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.network.neutron [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Updating instance_info_cache with network_info: [{"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b3a1555f-9e5b-4ecc-a701-3ede9b05dfe7 req-f8c5d138-d79f-4e46-a994-7918136dd2ad service nova] Releasing lock "refresh_cache-5fd40faf-6ffa-40ff-b437-dd82717d9489" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-vif-unplugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] No waiting events found dispatching network-vif-unplugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-496f144e-98a0-467f-93b6-4728f0b25361 req-9cee9053-f234-4085-804b-9c320c1b35c5 service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-vif-unplugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Instance destroyed successfully.
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.objects.instance [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'resources' on Instance uuid 5fd40faf-6ffa-40ff-b437-dd82717d9489 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78834662',display_name='tempest-AttachVolumeNegativeTest-server-78834662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78834662',id=21,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADHO2g4Wxo5uFCOEdCVbkMLrFL9fP1gcWaAZRsI44Qk7/GCV2Jx9IoTZMmvhldVm5kgL8hr47CmfuErH7Fbg6zlJ3CQ3hyZ8RhmjcLlo4w+Vva9kQGnWHeqbhqqYAh62g==',key_name='tempest-keypair-1283781213',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-9kefgks8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=5fd40faf-6ffa-40ff-b437-dd82717d9489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "address": "fa:16:3e:93:3e:ed", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef0930e-d8", "ovs_interfaceid": "fef0930e-d810-45b5-aecc-a933e3ef8d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG os_vif [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfef0930e-d8, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:35 user nova-compute[71654]: INFO os_vif [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:3e:ed,bridge_name='br-int',has_traffic_filtering=True,id=fef0930e-d810-45b5-aecc-a933e3ef8d35,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef0930e-d8')
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Deleting instance files /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489_del
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Deletion of /opt/stack/data/nova/instances/5fd40faf-6ffa-40ff-b437-dd82717d9489_del complete
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.compute.manager [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.compute.manager [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Detaching volume 1685129d-095f-4ce2-993a-cea1173d30cb
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.virt.block_device [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Attempting to driver detach volume 1685129d-095f-4ce2-993a-cea1173d30cb from mountpoint /dev/vdb
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Attempting to detach device vdb from instance 4c52ef94-8660-49a4-8105-5b63bfb187ff from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:46:35 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:35 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:46:35 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:46:35 user nova-compute[71654]:   <serial>1685129d-095f-4ce2-993a-cea1173d30cb</serial>
Apr 11 20:46:35 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:46:35 user nova-compute[71654]: </disk>
Apr 11 20:46:35 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:46:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully detached device vdb from instance 4c52ef94-8660-49a4-8105-5b63bfb187ff from the persistent domain config.
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c52ef94-8660-49a4-8105-5b63bfb187ff from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:46:35 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:35 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:46:35 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:46:35 user nova-compute[71654]:   <serial>1685129d-095f-4ce2-993a-cea1173d30cb</serial>
Apr 11 20:46:35 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:46:35 user nova-compute[71654]: </disk>
Apr 11 20:46:35 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:46:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681245996.0501995, 4c52ef94-8660-49a4-8105-5b63bfb187ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:46:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully detached device vdb from instance 4c52ef94-8660-49a4-8105-5b63bfb187ff from the live domain config.
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuJADKaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:36 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d15e9f-3963-4448-a714-26c5e7f727a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:46:36 user nova-compute[71654]: No targets found.
Apr 11 20:46:36 user nova-compute[71654]: iSNS:
Apr 11 20:46:36 user nova-compute[71654]: No targets found.
Apr 11 20:46:36 user nova-compute[71654]: STATIC:
Apr 11 20:46:36 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb
Apr 11 20:46:36 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:36 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:36 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:46:36 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:36 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:36 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c
Apr 11 20:46:36 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:36 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:36 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:46:36 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:36 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:36 user nova-compute[71654]: FIRMWARE:
Apr 11 20:46:36 user nova-compute[71654]: No targets found.
Apr 11 20:46:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:46:36 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:46:36 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbca68b-99dd-4b5b-b453-492e63ad2843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a49f250-cbfb-468f-b0a0-726661600609]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:36 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:36 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:36 user nova-compute[71654]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb (non-flash)
Apr 11 20:46:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:36 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:36 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:36 user nova-compute[71654]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb (non-flash)
Apr 11 20:46:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb402df250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee0cddc-e916-4b21-b6a0-0d7e0fa635f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb48ce-a466-41e8-b8b4-632518261484]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:36 user nova-compute[71654]: INFO nova.compute.manager [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Unshelving
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a70bec5-b132-4ca2-bca0-a33d571e88b5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f1652-5d5f-4e08-8ffc-311a61aedab6]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[71506a09-b831-42d1-b3c2-3f19d93f3280]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'pci_requests' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd23915c-637c-4780-bdb1-d3d4bac1385e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260]
Apr 11 20:46:36 user nova-compute[71654]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb, portal: 172.16.0.220,3260] successful.
Apr 11 20:46:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:46:36 user nova-compute[71654]: INFO nova.compute.claims [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Claim successful on node user
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[744c5ef6-fac0-44ea-b2ef-08c5065fdbd9]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== disconnect_volume: return (338ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:36 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Took 1.30 seconds to deallocate network for instance.
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.118s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:36 user nova-compute[71654]: INFO nova.network.neutron [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating port 70b946a4-0951-4e8c-adc6-ac21f5837691 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.objects.instance [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'flavor' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-aa797626-1781-4884-a6be-f46516f66ae3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.707s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.552s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:37 user nova-compute[71654]: INFO nova.compute.manager [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Terminating instance
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:46:37 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Deleted allocations for instance 5fd40faf-6ffa-40ff-b437-dd82717d9489
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Acquiring lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] No waiting events found dispatching network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:37 user nova-compute[71654]: WARNING nova.compute.manager [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received unexpected event network-vif-plugged-fef0930e-d810-45b5-aecc-a933e3ef8d35 for instance with vm_state deleted and task_state None.
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-19f297cb-e413-47a9-858b-d189d510178c req-a7dbcbdd-5115-456a-bac4-74757cdd62dd service nova] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Received event network-vif-deleted-fef0930e-d810-45b5-aecc-a933e3ef8d35 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-701a47b8-d073-4d32-94c0-db243e5f975b tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "5fd40faf-6ffa-40ff-b437-dd82717d9489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:46:37 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Instance destroyed successfully.
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.objects.instance [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'resources' on Instance uuid 4c52ef94-8660-49a4-8105-5b63bfb187ff {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-860608246',display_name='tempest-VolumesSnapshotTestJSON-instance-860608246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-860608246',id=20,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1982dc9f62644e2b8a541dc25854a6a9',ramdisk_id='',reservation_id='r-pp4bza0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-323644922',owner_user_name='tempest-VolumesSnapshotTestJSON-323644922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:44:37Z,user_data=None,user_id='94e4de8a85394d258268ff4304eccb2d',uuid=4c52ef94-8660-49a4-8105-5b63bfb187ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converting VIF {"id": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "address": "fa:16:3e:db:e5:5a", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704fb865-76", "ovs_interfaceid": "704fb865-76f6-4e89-b6f8-b69854f4bcc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:37 user nova-compute[71654]: DEBUG os_vif [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap704fb865-76, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:38 user nova-compute[71654]: INFO os_vif [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e5:5a,bridge_name='br-int',has_traffic_filtering=True,id=704fb865-76f6-4e89-b6f8-b69854f4bcc6,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704fb865-76')
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuJADKaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:38 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7317391-0b98-4883-8cbf-c66eb61cfbcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:46:38 user nova-compute[71654]: No targets found.
Apr 11 20:46:38 user nova-compute[71654]: iSNS:
Apr 11 20:46:38 user nova-compute[71654]: No targets found.
Apr 11 20:46:38 user nova-compute[71654]: STATIC:
Apr 11 20:46:38 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:46:38 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:38 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:38 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c
Apr 11 20:46:38 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:38 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:38 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:46:38 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:46:38 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:46:38 user nova-compute[71654]: FIRMWARE:
Apr 11 20:46:38 user nova-compute[71654]: No targets found.
Apr 11 20:46:38 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:46:38 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:46:38 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1685129d-095f-4ce2-993a-cea1173d30cb', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[10998500-2754-4a37-8666-ab1aa9ed448a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3431e8-fa07-4fd1-ac70-e12aa4fb4ed5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:38 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:38 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:38 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:38 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:38 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:38 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb402de3b0>, {}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Disconnecting from: [] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== disconnect_volume: return (73ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:46:38 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Deleting instance files /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff_del
Apr 11 20:46:38 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Deletion of /opt/stack/data/nova/instances/4c52ef94-8660-49a4-8105-5b63bfb187ff_del complete
Apr 11 20:46:38 user nova-compute[71654]: INFO nova.compute.manager [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.network.neutron [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:46:38 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Creating image(s)
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG nova.objects.instance [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "564a6cb10a479439d07021650f0e4ef66be96f73" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "564a6cb10a479439d07021650f0e4ef66be96f73" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received event network-vif-deleted-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:39 user nova-compute[71654]: INFO nova.compute.manager [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Neutron deleted interface 704fb865-76f6-4e89-b6f8-b69854f4bcc6; detaching it from the instance and deleting it from the info cache
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.network.neutron [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-c54ae0ff-6d16-4c68-a207-91c7a1896fbb req-c9b4f55c-b24b-4460-8adf-899739eda46a service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Detach interface failed, port_id=704fb865-76f6-4e89-b6f8-b69854f4bcc6, reason: Instance 4c52ef94-8660-49a4-8105-5b63bfb187ff could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:46:39 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Took 1.02 seconds to deallocate network for instance.
Apr 11 20:46:39 user nova-compute[71654]: WARNING nova.volume.cinder [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Attachment 5d3f4bdd-36dd-4d4d-8105-cbaea336a315 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5d3f4bdd-36dd-4d4d-8105-cbaea336a315. (HTTP 404) (Request-ID: req-4f9e8a07-bf8d-4523-bfaa-b2dcba1461b0)
Apr 11 20:46:39 user nova-compute[71654]: INFO nova.compute.manager [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Took 0.04 seconds to detach 1 volumes for instance.
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.virt.images [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] b77ab62b-227f-4a01-ad83-03df74883230 was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.part /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received event network-vif-unplugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] No waiting events found dispatching network-vif-unplugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:39 user nova-compute[71654]: WARNING nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received unexpected event network-vif-unplugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance with vm_state deleted and task_state None.
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing instance network info cache due to event network-changed-70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Acquiring lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Acquired lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.network.neutron [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Refreshing network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.part /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.converted" returned: 0 in 0.566s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.633s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:39 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Deleted allocations for instance 4c52ef94-8660-49a4-8105-5b63bfb187ff
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.network.neutron [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updated VIF entry in instance network info cache for port 70b946a4-0951-4e8c-adc6-ac21f5837691. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG nova.network.neutron [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "564a6cb10a479439d07021650f0e4ef66be96f73" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.540s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Releasing lock "refresh_cache-4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received event network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Acquiring lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] No waiting events found dispatching network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:40 user nova-compute[71654]: WARNING nova.compute.manager [req-08e0ac97-3531-43b0-bec9-6c685f4c307a req-8ae72b3f-fd9e-4337-b09a-76468f9bbe2c service nova] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Received unexpected event network-vif-plugged-704fb865-76f6-4e89-b6f8-b69854f4bcc6 for instance with vm_state deleted and task_state None.
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-339dd82c-80d9-4889-89c3-4fa5e3ab3574 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "4c52ef94-8660-49a4-8105-5b63bfb187ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.836s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "564a6cb10a479439d07021650f0e4ef66be96f73" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "564a6cb10a479439d07021650f0e4ef66be96f73" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73,backing_fmt=raw /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73,backing_fmt=raw /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk 1073741824" returned: 0 in 0.048s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "564a6cb10a479439d07021650f0e4ef66be96f73" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG nova.objects.instance [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'migration_context' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:40 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Rebasing disk image.
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d -F raw /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d -F raw /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk" returned: 0 in 2.062s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Ensure instance console log exists: /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Start _get_guest_xml network_info=[{"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bb96aa375136c2ca87f0cb7e76a1677a',container_format='bare',created_at=2023-04-11T20:44:43Z,direct_url=<?>,disk_format='qcow2',id=b77ab62b-227f-4a01-ad83-03df74883230,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-345208448-shelved',owner='0d5fce55f8224068805593f94d5f2d36',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T20:44:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:46:42 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:46:42 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bb96aa375136c2ca87f0cb7e76a1677a',container_format='bare',created_at=2023-04-11T20:44:43Z,direct_url=<?>,disk_format='qcow2',id=b77ab62b-227f-4a01-ad83-03df74883230,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-345208448-shelved',owner='0d5fce55f8224068805593f94d5f2d36',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T20:44:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.objects.instance [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345208448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345208448',id=16,image_ref='b77ab62b-227f-4a01-ad83-03df74883230',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-545600492',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:42:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-voquowxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member',shelved_at='2023-04-11T20:44:46.947898',shelved_host='user',shelved_image_id='b77ab62b-227f-4a01-ad83-03df74883230'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=4ad985d5-6fd0-48f3-be8f-00a7fc4791c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.objects.instance [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:46:42 user nova-compute[71654]:   <uuid>4ad985d5-6fd0-48f3-be8f-00a7fc4791c4</uuid>
Apr 11 20:46:42 user nova-compute[71654]:   <name>instance-00000010</name>
Apr 11 20:46:42 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:46:42 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:46:42 user nova-compute[71654]:   <metadata>
Apr 11 20:46:42 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:46:42 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:46:42 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-345208448</nova:name>
Apr 11 20:46:42 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:46:42</nova:creationTime>
Apr 11 20:46:42 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:46:42 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:46:42 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:46:42 user nova-compute[71654]:       <nova:owner>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:user uuid="f82468d207064eb288a2c8a167cd7d9d">tempest-AttachVolumeShelveTestJSON-426216861-project-member</nova:user>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:project uuid="0d5fce55f8224068805593f94d5f2d36">tempest-AttachVolumeShelveTestJSON-426216861</nova:project>
Apr 11 20:46:42 user nova-compute[71654]:       </nova:owner>
Apr 11 20:46:42 user nova-compute[71654]:       <nova:root type="image" uuid="b77ab62b-227f-4a01-ad83-03df74883230"/>
Apr 11 20:46:42 user nova-compute[71654]:       <nova:ports>
Apr 11 20:46:42 user nova-compute[71654]:         <nova:port uuid="70b946a4-0951-4e8c-adc6-ac21f5837691">
Apr 11 20:46:42 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 20:46:42 user nova-compute[71654]:         </nova:port>
Apr 11 20:46:42 user nova-compute[71654]:       </nova:ports>
Apr 11 20:46:42 user nova-compute[71654]:     </nova:instance>
Apr 11 20:46:42 user nova-compute[71654]:   </metadata>
Apr 11 20:46:42 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:46:42 user nova-compute[71654]:     <system>
Apr 11 20:46:42 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:46:42 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:46:42 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:46:42 user nova-compute[71654]:       <entry name="serial">4ad985d5-6fd0-48f3-be8f-00a7fc4791c4</entry>
Apr 11 20:46:42 user nova-compute[71654]:       <entry name="uuid">4ad985d5-6fd0-48f3-be8f-00a7fc4791c4</entry>
Apr 11 20:46:42 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:46:42 user nova-compute[71654]:     </system>
Apr 11 20:46:42 user nova-compute[71654]:   </sysinfo>
Apr 11 20:46:42 user nova-compute[71654]:   <os>
Apr 11 20:46:42 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:46:42 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:46:42 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:46:42 user nova-compute[71654]:   </os>
Apr 11 20:46:42 user nova-compute[71654]:   <features>
Apr 11 20:46:42 user nova-compute[71654]:     <acpi/>
Apr 11 20:46:42 user nova-compute[71654]:     <apic/>
Apr 11 20:46:42 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:46:42 user nova-compute[71654]:   </features>
Apr 11 20:46:42 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:46:42 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:46:42 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:46:42 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:46:42 user nova-compute[71654]:   </clock>
Apr 11 20:46:42 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:46:42 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:46:42 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:46:42 user nova-compute[71654]:   </cpu>
Apr 11 20:46:42 user nova-compute[71654]:   <devices>
Apr 11 20:46:42 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:46:42 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:46:42 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk"/>
Apr 11 20:46:42 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:46:42 user nova-compute[71654]:     </disk>
Apr 11 20:46:42 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:46:42 user nova-compute[71654]:       <mac address="fa:16:3e:ef:c2:2c"/>
Apr 11 20:46:42 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:46:42 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:46:42 user nova-compute[71654]:       <target dev="tap70b946a4-09"/>
Apr 11 20:46:42 user nova-compute[71654]:     </interface>
Apr 11 20:46:42 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:46:42 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/console.log" append="off"/>
Apr 11 20:46:42 user nova-compute[71654]:     </serial>
Apr 11 20:46:42 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:46:42 user nova-compute[71654]:     <video>
Apr 11 20:46:42 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:46:42 user nova-compute[71654]:     </video>
Apr 11 20:46:42 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:46:42 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:46:42 user nova-compute[71654]:     </rng>
Apr 11 20:46:42 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:46:42 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:46:42 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:46:42 user nova-compute[71654]:     </memballoon>
Apr 11 20:46:42 user nova-compute[71654]:   </devices>
Apr 11 20:46:42 user nova-compute[71654]: </domain>
Apr 11 20:46:42 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345208448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345208448',id=16,image_ref='b77ab62b-227f-4a01-ad83-03df74883230',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-545600492',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:42:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-voquowxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member',shelved_at='2023-04-11T20:44:46.947898',shelved_host='user',shelved_image_id='b77ab62b-227f-4a01-ad83-03df74883230'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=4ad985d5-6fd0-48f3-be8f-00a7fc4791c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG os_vif [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70b946a4-09, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70b946a4-09, col_values=(('external_ids', {'iface-id': '70b946a4-0951-4e8c-adc6-ac21f5837691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c2:2c', 'vm-uuid': '4ad985d5-6fd0-48f3-be8f-00a7fc4791c4'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:42 user nova-compute[71654]: INFO os_vif [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09')
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:46:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] No VIF found with MAC fa:16:3e:ef:c2:2c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:44 user nova-compute[71654]: WARNING nova.compute.manager [req-3bbd6228-93d2-4c45-8750-e03c85beb5df req-b3e7e5fe-6149-4091-8f95-12c4d44f38b6 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246006.2225006, 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] VM Resumed (Lifecycle Event)
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:46:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance spawned successfully.
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246006.2242415, 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] VM Started (Lifecycle Event)
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:46 user nova-compute[71654]: WARNING nova.compute.manager [req-bc428007-3ea3-4570-ba89-ec684448a6f5 req-61142604-9f62-41e0-b0e8-08a6f20f43aa service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 20:46:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-691126d6-f5dc-4051-97c5-49b792968112 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.389s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'flavor' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:48 user nova-compute[71654]: INFO nova.compute.manager [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Attaching volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb to /dev/vdb
Apr 11 20:46:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cc2916-0a64-478f-a298-e8b909bb4a42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c5439-4bcf-4e29-b119-b43f50eee664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ac56f-ae6d-48c4-87da-0bb6bb103b44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c061f-7c3a-498d-b81d-97fdc1be98a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:46:48 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:46:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[39743ba4-20ad-4428-bc49-16dd031eb409]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:48 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating existing volume attachment record: 1da85759-9d05-46b6-80b2-4fcd058995a3 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:46:50 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245995.2266579, 5fd40faf-6ffa-40ff-b437-dd82717d9489 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:50 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] VM Stopped (Lifecycle Event)
Apr 11 20:46:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1fa5ab2b-0ff2-4345-9273-bfccb4c335e2 None None] [instance: 5fd40faf-6ffa-40ff-b437-dd82717d9489] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:51 user nova-compute[71654]: INFO nova.compute.manager [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Unrescuing
Apr 11 20:46:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.objects.instance [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'flavor' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:52 user nova-compute[71654]: WARNING nova.compute.manager [req-19f63844-1298-4108-b1a4-2e436ba590b8 req-6fa0d02e-520a-4f10-8db1-36fde9da0bb6 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:46:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKEJwFIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:46:52 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:52 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:46:52 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c7aec-7100-40e7-9681-45ba1ddbf615]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:46:52 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f49a6e-d1a4-4866-ae55-5b1f8f834bb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb] added
Apr 11 20:46:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9649ad89-f41d-4601-89fa-e3fae8a4e6dc]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d454cce5-89e0-45fc-aa95-79ed2a88f843]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKEJwFIr {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKEJwFIr" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777b283-6f22-4a59-937b-1b264f0358ea]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKEJwFIr'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a45862e-7e80-4329-9d25-14f8daeb3e9f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640432a-f7f1-4def-8ad5-ea759623b7ac]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1439bc-4b5d-420f-a999-163289864d6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260]
Apr 11 20:46:52 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260] successful.
Apr 11 20:46:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b201a7-8104-4f47-98f1-9e7b43948089]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance destroyed successfully.
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b71f4e0-5a21-4384-beaf-649205ceb2c1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)
Apr 11 20:46:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:46:52 user nova-compute[71654]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)
Apr 11 20:46:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0870f4-80de-469f-af34-d39003e98ea9]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKEJwFIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681245997.977337, 4c52ef94-8660-49a4-8105-5b63bfb187ff => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:52 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] VM Stopped (Lifecycle Event)
Apr 11 20:46:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b3fbc346-bf78-4820-99f4-b1099f8f37d7 None None] [instance: 4c52ef94-8660-49a4-8105-5b63bfb187ff] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:46:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23861373738333838', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:46:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861373738333838', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:46:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'flavor' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:46:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:46:53 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:46:53 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:46:53 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:46:53 user nova-compute[71654]:   <serial>dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb</serial>
Apr 11 20:46:53 user nova-compute[71654]: </disk>
Apr 11 20:46:53 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:54 user nova-compute[71654]: WARNING nova.compute.manager [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:54 user nova-compute[71654]: WARNING nova.compute.manager [req-fda76568-80bc-439d-8fb4-bb39c83beb68 req-356617be-9662-4e3d-9835-0ca937d8c8db service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:46:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] No VIF found with MAC fa:16:3e:42:3b:00, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:46:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c8975cb7-8a44-4f63-bb2a-6946c6058105 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.497s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 097d9483-07ea-4dce-afd6-4d28dd0d2390 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246016.5531352, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Resumed (Lifecycle Event)
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-0d79a3f2-5132-4a71-bf3f-fb63fcfe73dd tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246016.557336, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:46:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Started (Lifecycle Event)
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:46:56 user nova-compute[71654]: WARNING nova.compute.manager [req-82e79cfd-06a3-403f-acf0-1a4e389f5121 req-6abd578f-4518-4984-b2ac-4de3b15772b7 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state active and task_state None.
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:46:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:46:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:46:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing instance network info cache due to event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:46:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:46:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:46:58 user nova-compute[71654]: DEBUG nova.network.neutron [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:46:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updated VIF entry in instance network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:46:59 user nova-compute[71654]: DEBUG nova.network.neutron [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:46:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-eb6a61c1-6963-48e7-b605-330f4922edf5 req-42801abf-a99c-4438-9fb3-54dd21b9c90c service nova] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:00 user nova-compute[71654]: INFO nova.compute.manager [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Rebooting instance
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing instance network info cache due to event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:00 user nova-compute[71654]: DEBUG nova.network.neutron [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:47:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updated VIF entry in instance network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:47:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a24f79d3-9d03-447c-acda-6eae076b664e req-1ab9324a-ba25-4fec-861f-636e294e0a58 service nova] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-unplugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-unplugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:03 user nova-compute[71654]: WARNING nova.compute.manager [req-f6f79b15-72e6-4e2c-bfa8-24e44abf2f4d req-6e83aca5-10b5-4c9a-8b43-1f2ba8804703 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-unplugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state active and task_state reboot_started.
Apr 11 20:47:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance shutdown successfully.
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:05 user nova-compute[71654]: WARNING nova.compute.manager [req-3dfb5b55-0c9f-4880-b886-9feff11df919 req-62b4ce00-9646-45ee-935a-f8f80317e8ce service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state active and task_state reboot_started.
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246027.1511815, 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] VM Resumed (Lifecycle Event)
Apr 11 20:47:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance running successfully.
Apr 11 20:47:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance soft rebooted successfully.
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246027.1520414, 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] VM Started (Lifecycle Event)
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3d1bb796-993b-4928-b034-daf2dcfaf15b tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.118s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:07 user nova-compute[71654]: WARNING nova.compute.manager [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state active and task_state None.
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:07 user nova-compute[71654]: WARNING nova.compute.manager [req-b2245429-abbc-4416-a520-6408cb0d92eb req-a9317b5d-2927-4ead-9905-d8873bd65d02 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state active and task_state None.
Apr 11 20:47:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:17 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:47:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:25 user nova-compute[71654]: INFO nova.compute.manager [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Detaching volume 5a6c57cf-e717-411e-98df-be3d3706bc6c
Apr 11 20:47:26 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:26 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7946MB free_disk=26.2867431640625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:26 user nova-compute[71654]: INFO nova.virt.block_device [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Attempting to driver detach volume 5a6c57cf-e717-411e-98df-be3d3706bc6c from mountpoint /dev/vdb
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Attempting to detach device vdb from instance 645e96f7-547e-4eea-8523-7f7918c0ad3e from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:47:26 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:47:26 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:47:26 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:47:26 user nova-compute[71654]:   <serial>5a6c57cf-e717-411e-98df-be3d3706bc6c</serial>
Apr 11 20:47:26 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:47:26 user nova-compute[71654]: </disk>
Apr 11 20:47:26 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:47:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully detached device vdb from instance 645e96f7-547e-4eea-8523-7f7918c0ad3e from the persistent domain config.
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 645e96f7-547e-4eea-8523-7f7918c0ad3e from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:47:26 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:47:26 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:47:26 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:47:26 user nova-compute[71654]:   <serial>5a6c57cf-e717-411e-98df-be3d3706bc6c</serial>
Apr 11 20:47:26 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:47:26 user nova-compute[71654]: </disk>
Apr 11 20:47:26 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 645e96f7-547e-4eea-8523-7f7918c0ad3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246046.8957999, 645e96f7-547e-4eea-8523-7f7918c0ad3e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:47:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully detached device vdb from instance 645e96f7-547e-4eea-8523-7f7918c0ad3e from the live domain config.
Apr 11 20:47:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeiqMXOD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:47:26 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba42c0-4733-43b9-b763-10cc32fb991a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:47:26 user nova-compute[71654]: No targets found.
Apr 11 20:47:26 user nova-compute[71654]: iSNS:
Apr 11 20:47:26 user nova-compute[71654]: No targets found.
Apr 11 20:47:26 user nova-compute[71654]: STATIC:
Apr 11 20:47:26 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb
Apr 11 20:47:26 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:47:26 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:47:26 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:47:26 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:47:26 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:47:26 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c
Apr 11 20:47:26 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:47:26 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:47:26 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:47:26 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:47:26 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:47:26 user nova-compute[71654]: FIRMWARE:
Apr 11 20:47:26 user nova-compute[71654]: No targets found.
Apr 11 20:47:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:47:26 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:47:26 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1119f3a-9007-42c7-9ce6-9448ae60bc59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec5efa-d982-45cc-b163-24baea0755f3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:47:26 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:47:26 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:47:26 user nova-compute[71654]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)
Apr 11 20:47:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:47:26 user nova-compute[71654]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c (non-flash)
Apr 11 20:47:26 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:47:26 user nova-compute[71654]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)
Apr 11 20:47:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e7d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:47:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b2320e-7078-4b5d-a5cc-29804c65d396]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6ecfa-6f65-42f6-9230-14ac29e8a0f1]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c65a0b-cc46-4ba8-870d-bb9a88b06c3a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e99f782-4416-4dbe-87db-8869eb423aa9]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c256a-7d95-4bda-8931-3efee21d8c09]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c7d7ee-8e88-44ba-b0db-592aa31bf5cf]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260]
Apr 11 20:47:27 user nova-compute[71654]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c, portal: 172.16.0.220,3260] successful.
Apr 11 20:47:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a6c57cf-e717-411e-98df-be3d3706bc6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb23bf9a-34d4-4859-9ee5-b5c24f0bd65f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== disconnect_volume: return (340ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:27 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:47:28 user nova-compute[71654]: DEBUG nova.objects.instance [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-76663439-760c-4717-935f-48df4fb3dcd9 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.173s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:47:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:47:31 user nova-compute[71654]: INFO nova.compute.claims [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Claim successful on node user
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:47:32 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.policy [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94e4de8a85394d258268ff4304eccb2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1982dc9f62644e2b8a541dc25854a6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:47:32 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Creating image(s)
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "/opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "/opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk 1073741824" returned: 0 in 0.052s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Cannot resize image /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'migration_context' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Ensure instance console log exists: /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Successfully created port: bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Successfully updated port: bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "refresh_cache-dfd1ff89-55fd-454d-a98f-2cab0388b86c" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquired lock "refresh_cache-dfd1ff89-55fd-454d-a98f-2cab0388b86c" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-changed-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Refreshing instance network info cache due to event network-changed-bd8a4a43-cc71-449b-8730-83aae6973e7f. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Acquiring lock "refresh_cache-dfd1ff89-55fd-454d-a98f-2cab0388b86c" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Updating instance_info_cache with network_info: [{"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Releasing lock "refresh_cache-dfd1ff89-55fd-454d-a98f-2cab0388b86c" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Instance network_info: |[{"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Acquired lock "refresh_cache-dfd1ff89-55fd-454d-a98f-2cab0388b86c" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Refreshing network info cache for port bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Start _get_guest_xml network_info=[{"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:47:34 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:34 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1075804271',display_name='tempest-VolumesSnapshotTestJSON-instance-1075804271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1075804271',id=23,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1982dc9f62644e2b8a541dc25854a6a9',ramdisk_id='',reservation_id='r-w7aogfng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-323644922',owner_user_name='tempest-VolumesSnapshotTestJSON-323644922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:47:32Z,user_data=None,user_id='94e4de8a85394d258268ff4304eccb2d',uuid=dfd1ff89-55fd-454d-a98f-2cab0388b86c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converting VIF {"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'pci_devices' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:47:34 user nova-compute[71654]:   <uuid>dfd1ff89-55fd-454d-a98f-2cab0388b86c</uuid>
Apr 11 20:47:34 user nova-compute[71654]:   <name>instance-00000017</name>
Apr 11 20:47:34 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:47:34 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:47:34 user nova-compute[71654]:   <metadata>
Apr 11 20:47:34 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:47:34 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:47:34 user nova-compute[71654]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1075804271</nova:name>
Apr 11 20:47:34 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:47:34</nova:creationTime>
Apr 11 20:47:34 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:47:34 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:47:34 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:47:34 user nova-compute[71654]:       <nova:owner>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:user uuid="94e4de8a85394d258268ff4304eccb2d">tempest-VolumesSnapshotTestJSON-323644922-project-member</nova:user>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:project uuid="1982dc9f62644e2b8a541dc25854a6a9">tempest-VolumesSnapshotTestJSON-323644922</nova:project>
Apr 11 20:47:34 user nova-compute[71654]:       </nova:owner>
Apr 11 20:47:34 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:47:34 user nova-compute[71654]:       <nova:ports>
Apr 11 20:47:34 user nova-compute[71654]:         <nova:port uuid="bd8a4a43-cc71-449b-8730-83aae6973e7f">
Apr 11 20:47:34 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 20:47:34 user nova-compute[71654]:         </nova:port>
Apr 11 20:47:34 user nova-compute[71654]:       </nova:ports>
Apr 11 20:47:34 user nova-compute[71654]:     </nova:instance>
Apr 11 20:47:34 user nova-compute[71654]:   </metadata>
Apr 11 20:47:34 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:47:34 user nova-compute[71654]:     <system>
Apr 11 20:47:34 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:47:34 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:47:34 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:47:34 user nova-compute[71654]:       <entry name="serial">dfd1ff89-55fd-454d-a98f-2cab0388b86c</entry>
Apr 11 20:47:34 user nova-compute[71654]:       <entry name="uuid">dfd1ff89-55fd-454d-a98f-2cab0388b86c</entry>
Apr 11 20:47:34 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:47:34 user nova-compute[71654]:     </system>
Apr 11 20:47:34 user nova-compute[71654]:   </sysinfo>
Apr 11 20:47:34 user nova-compute[71654]:   <os>
Apr 11 20:47:34 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:47:34 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:47:34 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:47:34 user nova-compute[71654]:   </os>
Apr 11 20:47:34 user nova-compute[71654]:   <features>
Apr 11 20:47:34 user nova-compute[71654]:     <acpi/>
Apr 11 20:47:34 user nova-compute[71654]:     <apic/>
Apr 11 20:47:34 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:47:34 user nova-compute[71654]:   </features>
Apr 11 20:47:34 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:47:34 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:47:34 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:47:34 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:47:34 user nova-compute[71654]:   </clock>
Apr 11 20:47:34 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:47:34 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:47:34 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:47:34 user nova-compute[71654]:   </cpu>
Apr 11 20:47:34 user nova-compute[71654]:   <devices>
Apr 11 20:47:34 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:47:34 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:47:34 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk"/>
Apr 11 20:47:34 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:47:34 user nova-compute[71654]:     </disk>
Apr 11 20:47:34 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:47:34 user nova-compute[71654]:       <mac address="fa:16:3e:f6:10:c4"/>
Apr 11 20:47:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:47:34 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:47:34 user nova-compute[71654]:       <target dev="tapbd8a4a43-cc"/>
Apr 11 20:47:34 user nova-compute[71654]:     </interface>
Apr 11 20:47:34 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:47:34 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/console.log" append="off"/>
Apr 11 20:47:34 user nova-compute[71654]:     </serial>
Apr 11 20:47:34 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:47:34 user nova-compute[71654]:     <video>
Apr 11 20:47:34 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:47:34 user nova-compute[71654]:     </video>
Apr 11 20:47:34 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:47:34 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:47:34 user nova-compute[71654]:     </rng>
Apr 11 20:47:34 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:47:34 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:47:34 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:47:34 user nova-compute[71654]:     </memballoon>
Apr 11 20:47:34 user nova-compute[71654]:   </devices>
Apr 11 20:47:34 user nova-compute[71654]: </domain>
Apr 11 20:47:34 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1075804271',display_name='tempest-VolumesSnapshotTestJSON-instance-1075804271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1075804271',id=23,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1982dc9f62644e2b8a541dc25854a6a9',ramdisk_id='',reservation_id='r-w7aogfng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-323644922',owner_user_name='tempest-VolumesSnapshotTestJSON-323644922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:47:32Z,user_data=None,user_id='94e4de8a85394d258268ff4304eccb2d',uuid=dfd1ff89-55fd-454d-a98f-2cab0388b86c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converting VIF {"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG os_vif [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd8a4a43-cc, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd8a4a43-cc, col_values=(('external_ids', {'iface-id': 'bd8a4a43-cc71-449b-8730-83aae6973e7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:10:c4', 'vm-uuid': 'dfd1ff89-55fd-454d-a98f-2cab0388b86c'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:34 user nova-compute[71654]: INFO os_vif [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc')
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No VIF found with MAC fa:16:3e:f6:10:c4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Updated VIF entry in instance network info cache for port bd8a4a43-cc71-449b-8730-83aae6973e7f. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Updating instance_info_cache with network_info: [{"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-478177d7-8d9e-40af-aed7-56bc31d87850 req-6a0f073d-a5e0-4143-b5af-c1ed0edd4cbc service nova] Releasing lock "refresh_cache-dfd1ff89-55fd-454d-a98f-2cab0388b86c" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] No waiting events found dispatching network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:36 user nova-compute[71654]: WARNING nova.compute.manager [req-44b7b4ea-cf07-448d-bb63-b74cf7fb6b1a req-b1dbb986-1025-448d-b6ee-a4c0f621a1ac service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received unexpected event network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f for instance with vm_state building and task_state spawning.
Apr 11 20:47:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246057.8975272, dfd1ff89-55fd-454d-a98f-2cab0388b86c => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] VM Resumed (Lifecycle Event)
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:47:37 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Instance spawned successfully.
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:47:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246057.9008234, dfd1ff89-55fd-454d-a98f-2cab0388b86c => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] VM Started (Lifecycle Event)
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:47:38 user nova-compute[71654]: INFO nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Took 5.41 seconds to spawn the instance on the hypervisor.
Apr 11 20:47:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:38 user nova-compute[71654]: INFO nova.compute.manager [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Took 6.14 seconds to build instance.
Apr 11 20:47:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d0463705-2d39-4c09-9bdb-d577fb2d81a9 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.231s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] No waiting events found dispatching network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:38 user nova-compute[71654]: WARNING nova.compute.manager [req-389a3e24-be29-469b-90af-0ea4167874b8 req-4e95998a-8074-4d85-81c4-beae67c045f0 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received unexpected event network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f for instance with vm_state active and task_state None.
Apr 11 20:47:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:42 user nova-compute[71654]: INFO nova.compute.manager [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Rescuing
Apr 11 20:47:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:47:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:43 user nova-compute[71654]: WARNING nova.compute.manager [req-8fb65fcc-f35d-434d-844d-17ebd580b81b req-a2ddd6d1-b857-4ef2-a0ac-60218f0e4522 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state active and task_state rescuing.
Apr 11 20:47:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance destroyed successfully.
Apr 11 20:47:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Attempting rescue
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71654) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:47:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Creating image(s)
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue" returned: 0 in 0.064s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'migration_context' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Start _get_guest_xml network_info=[{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:f6:6b:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'resources' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'numa_topology' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:47:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1539085704',display_name='tempest-ServerRescueNegativeTestJSON-server-1539085704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1539085704',id=17,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-4f9q1axh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:43:07Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=05f0405b-e73d-4c84-8208-21194ab434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:f6:6b:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:f6:6b:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'pci_devices' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:47:44 user nova-compute[71654]:   <uuid>05f0405b-e73d-4c84-8208-21194ab434d2</uuid>
Apr 11 20:47:44 user nova-compute[71654]:   <name>instance-00000011</name>
Apr 11 20:47:44 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:47:44 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:47:44 user nova-compute[71654]:   <metadata>
Apr 11 20:47:44 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:47:44 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:47:44 user nova-compute[71654]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1539085704</nova:name>
Apr 11 20:47:44 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:47:43</nova:creationTime>
Apr 11 20:47:44 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:47:44 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:47:44 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:47:44 user nova-compute[71654]:       <nova:owner>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:user uuid="dce0b6fa6d9546c8a04b7a4a5f93e0c7">tempest-ServerRescueNegativeTestJSON-777351805-project-member</nova:user>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:project uuid="a2ad2f73c14141dd8f7aa0d6f6c747b0">tempest-ServerRescueNegativeTestJSON-777351805</nova:project>
Apr 11 20:47:44 user nova-compute[71654]:       </nova:owner>
Apr 11 20:47:44 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:47:44 user nova-compute[71654]:       <nova:ports>
Apr 11 20:47:44 user nova-compute[71654]:         <nova:port uuid="730dc28f-1a82-4d35-af86-4a5744bd7ef0">
Apr 11 20:47:44 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:47:44 user nova-compute[71654]:         </nova:port>
Apr 11 20:47:44 user nova-compute[71654]:       </nova:ports>
Apr 11 20:47:44 user nova-compute[71654]:     </nova:instance>
Apr 11 20:47:44 user nova-compute[71654]:   </metadata>
Apr 11 20:47:44 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:47:44 user nova-compute[71654]:     <system>
Apr 11 20:47:44 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:47:44 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:47:44 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:47:44 user nova-compute[71654]:       <entry name="serial">05f0405b-e73d-4c84-8208-21194ab434d2</entry>
Apr 11 20:47:44 user nova-compute[71654]:       <entry name="uuid">05f0405b-e73d-4c84-8208-21194ab434d2</entry>
Apr 11 20:47:44 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:47:44 user nova-compute[71654]:     </system>
Apr 11 20:47:44 user nova-compute[71654]:   </sysinfo>
Apr 11 20:47:44 user nova-compute[71654]:   <os>
Apr 11 20:47:44 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:47:44 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:47:44 user nova-compute[71654]:   </os>
Apr 11 20:47:44 user nova-compute[71654]:   <features>
Apr 11 20:47:44 user nova-compute[71654]:     <acpi/>
Apr 11 20:47:44 user nova-compute[71654]:     <apic/>
Apr 11 20:47:44 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:47:44 user nova-compute[71654]:   </features>
Apr 11 20:47:44 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:47:44 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:47:44 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:47:44 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:47:44 user nova-compute[71654]:   </clock>
Apr 11 20:47:44 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:47:44 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:47:44 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:47:44 user nova-compute[71654]:   </cpu>
Apr 11 20:47:44 user nova-compute[71654]:   <devices>
Apr 11 20:47:44 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:47:44 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:47:44 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue"/>
Apr 11 20:47:44 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:47:44 user nova-compute[71654]:     </disk>
Apr 11 20:47:44 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:47:44 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:47:44 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk"/>
Apr 11 20:47:44 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:47:44 user nova-compute[71654]:     </disk>
Apr 11 20:47:44 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:47:44 user nova-compute[71654]:       <mac address="fa:16:3e:f6:6b:1c"/>
Apr 11 20:47:44 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:47:44 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:47:44 user nova-compute[71654]:       <target dev="tap730dc28f-1a"/>
Apr 11 20:47:44 user nova-compute[71654]:     </interface>
Apr 11 20:47:44 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:47:44 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/console.log" append="off"/>
Apr 11 20:47:44 user nova-compute[71654]:     </serial>
Apr 11 20:47:44 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:47:44 user nova-compute[71654]:     <video>
Apr 11 20:47:44 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:47:44 user nova-compute[71654]:     </video>
Apr 11 20:47:44 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:47:44 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:47:44 user nova-compute[71654]:     </rng>
Apr 11 20:47:44 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:47:44 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:47:44 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:47:44 user nova-compute[71654]:     </memballoon>
Apr 11 20:47:44 user nova-compute[71654]:   </devices>
Apr 11 20:47:44 user nova-compute[71654]: </domain>
Apr 11 20:47:44 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:47:44 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance destroyed successfully.
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:f6:6b:1c, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:47:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:45 user nova-compute[71654]: WARNING nova.compute.manager [req-558f9dd7-bdd7-4542-bbc7-d9f821dad45b req-a7e9e818-aef9-4f60-8f8c-d6c5e8ea73ad service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state active and task_state rescuing.
Apr 11 20:47:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:47 user nova-compute[71654]: WARNING nova.compute.manager [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state active and task_state rescuing.
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:47 user nova-compute[71654]: WARNING nova.compute.manager [req-abc94931-2fed-4c24-a030-9ec0cc1a49de req-e7c2b4eb-3417-4d3c-bb86-3aeece91405e service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state active and task_state rescuing.
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 05f0405b-e73d-4c84-8208-21194ab434d2 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246067.552044, 05f0405b-e73d-4c84-8208-21194ab434d2 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:47 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Resumed (Lifecycle Event)
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dee31aeb-ed43-41b7-90ef-0eca1548d3df tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:47 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246067.5536828, 05f0405b-e73d-4c84-8208-21194ab434d2 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:47 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Started (Lifecycle Event)
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'info_cache' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:47:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:47:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance destroyed successfully.
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'resources' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG os_vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap087e4499-cf, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:47:55 user nova-compute[71654]: INFO os_vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf')
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start _get_guest_xml network_info=[{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'numa_topology' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:55 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:55 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'pci_devices' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:47:55 user nova-compute[71654]:   <uuid>9613dc9f-5683-4139-bbed-0c2a11c2dc31</uuid>
Apr 11 20:47:55 user nova-compute[71654]:   <name>instance-0000000e</name>
Apr 11 20:47:55 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:47:55 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:47:55 user nova-compute[71654]:   <metadata>
Apr 11 20:47:55 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:47:55 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:47:55 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeTestJSON-server-1899891318</nova:name>
Apr 11 20:47:55 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:47:55</nova:creationTime>
Apr 11 20:47:55 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:47:55 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:47:55 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:47:55 user nova-compute[71654]:       <nova:owner>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:user uuid="3c9f583cc98040bc822e1ac7e418aa98">tempest-AttachVolumeTestJSON-968541948-project-member</nova:user>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:project uuid="426d5e042ba34969a2bfdc0c89da11e8">tempest-AttachVolumeTestJSON-968541948</nova:project>
Apr 11 20:47:55 user nova-compute[71654]:       </nova:owner>
Apr 11 20:47:55 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:47:55 user nova-compute[71654]:       <nova:ports>
Apr 11 20:47:55 user nova-compute[71654]:         <nova:port uuid="087e4499-cfde-448a-b093-08f4b879f946">
Apr 11 20:47:55 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 20:47:55 user nova-compute[71654]:         </nova:port>
Apr 11 20:47:55 user nova-compute[71654]:       </nova:ports>
Apr 11 20:47:55 user nova-compute[71654]:     </nova:instance>
Apr 11 20:47:55 user nova-compute[71654]:   </metadata>
Apr 11 20:47:55 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:47:55 user nova-compute[71654]:     <system>
Apr 11 20:47:55 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:47:55 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:47:55 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:47:55 user nova-compute[71654]:       <entry name="serial">9613dc9f-5683-4139-bbed-0c2a11c2dc31</entry>
Apr 11 20:47:55 user nova-compute[71654]:       <entry name="uuid">9613dc9f-5683-4139-bbed-0c2a11c2dc31</entry>
Apr 11 20:47:55 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:47:55 user nova-compute[71654]:     </system>
Apr 11 20:47:55 user nova-compute[71654]:   </sysinfo>
Apr 11 20:47:55 user nova-compute[71654]:   <os>
Apr 11 20:47:55 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:47:55 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:47:55 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:47:55 user nova-compute[71654]:   </os>
Apr 11 20:47:55 user nova-compute[71654]:   <features>
Apr 11 20:47:55 user nova-compute[71654]:     <acpi/>
Apr 11 20:47:55 user nova-compute[71654]:     <apic/>
Apr 11 20:47:55 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:47:55 user nova-compute[71654]:   </features>
Apr 11 20:47:55 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:47:55 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:47:55 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:47:55 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:47:55 user nova-compute[71654]:   </clock>
Apr 11 20:47:55 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:47:55 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:47:55 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:47:55 user nova-compute[71654]:   </cpu>
Apr 11 20:47:55 user nova-compute[71654]:   <devices>
Apr 11 20:47:55 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:47:55 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:47:55 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk"/>
Apr 11 20:47:55 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:47:55 user nova-compute[71654]:     </disk>
Apr 11 20:47:55 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:47:55 user nova-compute[71654]:       <mac address="fa:16:3e:1a:3b:8b"/>
Apr 11 20:47:55 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:47:55 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:47:55 user nova-compute[71654]:       <target dev="tap087e4499-cf"/>
Apr 11 20:47:55 user nova-compute[71654]:     </interface>
Apr 11 20:47:55 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:47:55 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/console.log" append="off"/>
Apr 11 20:47:55 user nova-compute[71654]:     </serial>
Apr 11 20:47:55 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:47:55 user nova-compute[71654]:     <video>
Apr 11 20:47:55 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:47:55 user nova-compute[71654]:     </video>
Apr 11 20:47:55 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:47:55 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:47:55 user nova-compute[71654]:     </rng>
Apr 11 20:47:55 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:47:55 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:47:55 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:47:55 user nova-compute[71654]:     </memballoon>
Apr 11 20:47:55 user nova-compute[71654]:   </devices>
Apr 11 20:47:55 user nova-compute[71654]: </domain>
Apr 11 20:47:55 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Cannot resize image /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'migration_context' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG os_vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap087e4499-cf, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap087e4499-cf, col_values=(('external_ids', {'iface-id': '087e4499-cfde-448a-b093-08f4b879f946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:3b:8b', 'vm-uuid': '9613dc9f-5683-4139-bbed-0c2a11c2dc31'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:47:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:55 user nova-compute[71654]: INFO os_vif [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf')
Apr 11 20:47:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:57 user nova-compute[71654]: WARNING nova.compute.manager [req-cee22190-adfd-459d-9746-888ba04fc1dd req-a8636fac-29c7-4986-aeef-a0a753fd963e service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state stopped and task_state powering-on.
Apr 11 20:47:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246079.3790398, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:59 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Resumed (Lifecycle Event)
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:47:59 user nova-compute[71654]: WARNING nova.compute.manager [req-c1cacd28-ccb6-4798-8725-fc2313c6c8d2 req-ec167b02-7f46-4a65-a66f-58f1104ebffc service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state stopped and task_state powering-on.
Apr 11 20:47:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance rebooted successfully.
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1cd24ee8-a656-4c3a-bebb-1d55a61a728d tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:59 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246079.3843925, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:47:59 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Started (Lifecycle Event)
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:47:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:47:59 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 20:48:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:16 user nova-compute[71654]: INFO nova.compute.manager [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Terminating instance
Apr 11 20:48:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-vif-unplugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] No waiting events found dispatching network-vif-unplugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-cdae6edb-0953-46ba-89cc-34a4c2630e66 req-d9c5ee87-1709-46bc-b292-de6e9c69e506 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-vif-unplugged-7e936873-bcfe-497e-b850-374d6ae930a6 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Instance destroyed successfully.
Apr 11 20:48:17 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'resources' on Instance uuid 645e96f7-547e-4eea-8523-7f7918c0ad3e {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-197605793',display_name='tempest-AttachVolumeNegativeTest-server-197605793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-197605793',id=15,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEd9qv94tRkT45FuNHkmLkkpIBVswbIY16UkibPoyN1X5rD6j733moSAHr5g2t/t4SlwcLf7Ob21UpIrp1iW3TfXNOEKKmcMWCuF6+soRAAJS05EI3VRMpEWmnJ6ZTAqQ==',key_name='tempest-keypair-668966515',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-pzh042r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=645e96f7-547e-4eea-8523-7f7918c0ad3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "7e936873-bcfe-497e-b850-374d6ae930a6", "address": "fa:16:3e:6e:74:f1", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e936873-bc", "ovs_interfaceid": "7e936873-bcfe-497e-b850-374d6ae930a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG os_vif [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e936873-bc, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:48:17 user nova-compute[71654]: INFO os_vif [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:74:f1,bridge_name='br-int',has_traffic_filtering=True,id=7e936873-bcfe-497e-b850-374d6ae930a6,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e936873-bc')
Apr 11 20:48:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Deleting instance files /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e_del
Apr 11 20:48:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Deletion of /opt/stack/data/nova/instances/645e96f7-547e-4eea-8523-7f7918c0ad3e_del complete
Apr 11 20:48:17 user nova-compute[71654]: INFO nova.compute.manager [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 20:48:17 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:48:17 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:18 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Took 1.24 seconds to deallocate network for instance.
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-1252cfb9-6114-460f-97e7-05d88cb7fe4e req-a960a8ff-f346-411f-a0fa-e717eef8c308 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-vif-deleted-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received event network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Acquiring lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] No waiting events found dispatching network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:18 user nova-compute[71654]: WARNING nova.compute.manager [req-81a7bdf0-0c0d-4340-b984-0713f3d6e740 req-3b1a607c-ac10-4214-a6ef-8134f13c1084 service nova] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Received unexpected event network-vif-plugged-7e936873-bcfe-497e-b850-374d6ae930a6 for instance with vm_state deleted and task_state None.
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:18 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Deleted allocations for instance 645e96f7-547e-4eea-8523-7f7918c0ad3e
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c54a69c5-05fa-4c38-a22b-af6750122131 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "645e96f7-547e-4eea-8523-7f7918c0ad3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:48:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:22 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:25 user nova-compute[71654]: INFO nova.compute.manager [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Terminating instance
Apr 11 20:48:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-unplugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-unplugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-2d07e6a6-f6bb-424b-8239-7625f3c55ddb req-b7208871-257b-4aaa-84c9-942e35584beb service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-unplugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:48:26 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:48:26 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=26.25731658935547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Instance destroyed successfully.
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lazy-loading 'resources' on Instance uuid 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345208448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345208448',id=16,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXzG/+iyFuLq/UP2Nf5869PwPaIxZUHlcTfcaQgIRL9ghHbGCVYa9ZHifqpcdGOoDPU/AR9Vn/W3qYR1rkx0sBJJpcHf1bVwdR/Ko66Ttz3Mo82/6YMPmg7BC5ao/FyXQ==',key_name='tempest-keypair-545600492',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d5fce55f8224068805593f94d5f2d36',ramdisk_id='',reservation_id='r-voquowxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-426216861',owner_user_name='tempest-AttachVolumeShelveTestJSON-426216861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f82468d207064eb288a2c8a167cd7d9d',uuid=4ad985d5-6fd0-48f3-be8f-00a7fc4791c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converting VIF {"id": "70b946a4-0951-4e8c-adc6-ac21f5837691", "address": "fa:16:3e:ef:c2:2c", "network": {"id": "88ce8103-e878-4fd8-b5cc-78a05d373fc5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1314583534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d5fce55f8224068805593f94d5f2d36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70b946a4-09", "ovs_interfaceid": "70b946a4-0951-4e8c-adc6-ac21f5837691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG os_vif [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70b946a4-09, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:48:26 user nova-compute[71654]: INFO os_vif [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:2c,bridge_name='br-int',has_traffic_filtering=True,id=70b946a4-0951-4e8c-adc6-ac21f5837691,network=Network(88ce8103-e878-4fd8-b5cc-78a05d373fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70b946a4-09')
Apr 11 20:48:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Deleting instance files /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4_del
Apr 11 20:48:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Deletion of /opt/stack/data/nova/instances/4ad985d5-6fd0-48f3-be8f-00a7fc4791c4_del complete
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dadac585-3a7c-40d8-a335-fc2603588c28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:48:26 user nova-compute[71654]: INFO nova.compute.manager [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 20:48:26 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:48:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:27 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Took 0.70 seconds to deallocate network for instance.
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-83f1aa9d-b0ea-477b-ac2a-83fd47169743 req-133ce6f5-7226-42c9-8326-f6c0327ef145 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-deleted-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:48:27 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.642s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:48:28 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Deleted allocations for instance 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4
Apr 11 20:48:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Acquiring lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] No waiting events found dispatching network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:28 user nova-compute[71654]: WARNING nova.compute.manager [req-0a3c74a0-fd5b-4855-8009-52ed0a812a75 req-816c0e7c-f8b7-4b8d-9afc-c7349a8b2597 service nova] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Received unexpected event network-vif-plugged-70b946a4-0951-4e8c-adc6-ac21f5837691 for instance with vm_state deleted and task_state None.
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-efd7e3c0-c0d9-40f4-977a-cd11b7f3b7b1 tempest-AttachVolumeShelveTestJSON-426216861 tempest-AttachVolumeShelveTestJSON-426216861-project-member] Lock "4ad985d5-6fd0-48f3-be8f-00a7fc4791c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [{"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-9613dc9f-5683-4139-bbed-0c2a11c2dc31" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:48:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:32 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246097.03185, 645e96f7-547e-4eea-8523-7f7918c0ad3e => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:48:32 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] VM Stopped (Lifecycle Event)
Apr 11 20:48:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1348223f-0c6c-4a53-a955-17c4bdd53d0c None None] [instance: 645e96f7-547e-4eea-8523-7f7918c0ad3e] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:48:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:41 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246106.7647345, 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:48:41 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] VM Stopped (Lifecycle Event)
Apr 11 20:48:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d0eea9d2-19bd-4e7b-98ee-2e9508bc9976 None None] [instance: 4ad985d5-6fd0-48f3-be8f-00a7fc4791c4] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:48:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:48:43 user nova-compute[71654]: INFO nova.compute.claims [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Claim successful on node user
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:48:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.policy [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:48:43 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Creating image(s)
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.128s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk 1073741824" returned: 0 in 0.049s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Cannot resize image /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'migration_context' on Instance uuid 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Ensure instance console log exists: /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Successfully created port: 81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Successfully updated port: 81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-changed-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Refreshing instance network info cache due to event network-changed-81b40e8f-efea-4c1a-8153-999d8b566b81. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Acquiring lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Updating instance_info_cache with network_info: [{"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Instance network_info: |[{"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Acquired lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.neutron [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Refreshing network info cache for port 81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Start _get_guest_xml network_info=[{"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:48:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:48:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-88977129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-88977129',id=24,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-hlyd5z68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:48:44Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=9cd9582e-3d22-4d3d-8c25-e9274fbb55b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:48:45 user nova-compute[71654]:   <uuid>9cd9582e-3d22-4d3d-8c25-e9274fbb55b3</uuid>
Apr 11 20:48:45 user nova-compute[71654]:   <name>instance-00000018</name>
Apr 11 20:48:45 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:48:45 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:48:45 user nova-compute[71654]:   <metadata>
Apr 11 20:48:45 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:48:45 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:48:45 user nova-compute[71654]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-88977129</nova:name>
Apr 11 20:48:45 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:48:45</nova:creationTime>
Apr 11 20:48:45 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:48:45 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:48:45 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:48:45 user nova-compute[71654]:       <nova:owner>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:user uuid="1d5cb62cc3844248be2e4456d970ccdf">tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member</nova:user>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:project uuid="85bf8fe34838426ea05060463458e5e0">tempest-ServerBootFromVolumeStableRescueTest-243239500</nova:project>
Apr 11 20:48:45 user nova-compute[71654]:       </nova:owner>
Apr 11 20:48:45 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:48:45 user nova-compute[71654]:       <nova:ports>
Apr 11 20:48:45 user nova-compute[71654]:         <nova:port uuid="81b40e8f-efea-4c1a-8153-999d8b566b81">
Apr 11 20:48:45 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 20:48:45 user nova-compute[71654]:         </nova:port>
Apr 11 20:48:45 user nova-compute[71654]:       </nova:ports>
Apr 11 20:48:45 user nova-compute[71654]:     </nova:instance>
Apr 11 20:48:45 user nova-compute[71654]:   </metadata>
Apr 11 20:48:45 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:48:45 user nova-compute[71654]:     <system>
Apr 11 20:48:45 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:48:45 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:48:45 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:48:45 user nova-compute[71654]:       <entry name="serial">9cd9582e-3d22-4d3d-8c25-e9274fbb55b3</entry>
Apr 11 20:48:45 user nova-compute[71654]:       <entry name="uuid">9cd9582e-3d22-4d3d-8c25-e9274fbb55b3</entry>
Apr 11 20:48:45 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:48:45 user nova-compute[71654]:     </system>
Apr 11 20:48:45 user nova-compute[71654]:   </sysinfo>
Apr 11 20:48:45 user nova-compute[71654]:   <os>
Apr 11 20:48:45 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:48:45 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:48:45 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:48:45 user nova-compute[71654]:   </os>
Apr 11 20:48:45 user nova-compute[71654]:   <features>
Apr 11 20:48:45 user nova-compute[71654]:     <acpi/>
Apr 11 20:48:45 user nova-compute[71654]:     <apic/>
Apr 11 20:48:45 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:48:45 user nova-compute[71654]:   </features>
Apr 11 20:48:45 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:48:45 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:48:45 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:48:45 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:48:45 user nova-compute[71654]:   </clock>
Apr 11 20:48:45 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:48:45 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:48:45 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:48:45 user nova-compute[71654]:   </cpu>
Apr 11 20:48:45 user nova-compute[71654]:   <devices>
Apr 11 20:48:45 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:48:45 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:48:45 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk"/>
Apr 11 20:48:45 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:48:45 user nova-compute[71654]:     </disk>
Apr 11 20:48:45 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:48:45 user nova-compute[71654]:       <mac address="fa:16:3e:b2:95:7b"/>
Apr 11 20:48:45 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:48:45 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:48:45 user nova-compute[71654]:       <target dev="tap81b40e8f-ef"/>
Apr 11 20:48:45 user nova-compute[71654]:     </interface>
Apr 11 20:48:45 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:48:45 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/console.log" append="off"/>
Apr 11 20:48:45 user nova-compute[71654]:     </serial>
Apr 11 20:48:45 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:48:45 user nova-compute[71654]:     <video>
Apr 11 20:48:45 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:48:45 user nova-compute[71654]:     </video>
Apr 11 20:48:45 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:48:45 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:48:45 user nova-compute[71654]:     </rng>
Apr 11 20:48:45 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:48:45 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:48:45 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:48:45 user nova-compute[71654]:     </memballoon>
Apr 11 20:48:45 user nova-compute[71654]:   </devices>
Apr 11 20:48:45 user nova-compute[71654]: </domain>
Apr 11 20:48:45 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-88977129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-88977129',id=24,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-hlyd5z68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:48:44Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=9cd9582e-3d22-4d3d-8c25-e9274fbb55b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG os_vif [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b40e8f-ef, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81b40e8f-ef, col_values=(('external_ids', {'iface-id': '81b40e8f-efea-4c1a-8153-999d8b566b81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:95:7b', 'vm-uuid': '9cd9582e-3d22-4d3d-8c25-e9274fbb55b3'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:45 user nova-compute[71654]: INFO os_vif [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef')
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:48:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No VIF found with MAC fa:16:3e:b2:95:7b, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:48:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Updated VIF entry in instance network info cache for port 81b40e8f-efea-4c1a-8153-999d8b566b81. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:48:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Updating instance_info_cache with network_info: [{"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f173c9ce-b23b-4720-9145-8c0d1dd0e06c req-8dfde139-9a51-46fc-b06c-dbd453bf63aa service nova] Releasing lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:48:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] No waiting events found dispatching network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:47 user nova-compute[71654]: WARNING nova.compute.manager [req-e957a332-c3a9-4d74-af28-9be07e42dabe req-e2c370d5-4221-4dcc-b8e6-2e2278071a9c service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received unexpected event network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 for instance with vm_state building and task_state spawning.
Apr 11 20:48:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246129.3161798, 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] VM Resumed (Lifecycle Event)
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Instance spawned successfully.
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246129.3196282, 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] VM Started (Lifecycle Event)
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] No waiting events found dispatching network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:49 user nova-compute[71654]: WARNING nova.compute.manager [req-376dc1dd-85ee-4a16-8a26-b423a4437a39 req-be4aea68-33e0-457c-840b-becaf42c24f4 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received unexpected event network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 for instance with vm_state building and task_state spawning.
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:48:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:48:49 user nova-compute[71654]: INFO nova.compute.manager [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Took 6.33 seconds to build instance.
Apr 11 20:48:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1210a838-a03c-4ef2-b92c-211f871b31ea tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.441s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing instance network info cache due to event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updated VIF entry in instance network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:48:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-337e36cc-7472-4c04-8811-96724df45023 req-762149bd-35eb-44d8-8320-73085f52fd71 service nova] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing instance network info cache due to event network-changed-91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Acquiring lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Acquired lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.network.neutron [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Refreshing network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:52 user nova-compute[71654]: INFO nova.compute.manager [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Detaching volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb
Apr 11 20:48:52 user nova-compute[71654]: INFO nova.virt.block_device [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Attempting to driver detach volume dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb from mountpoint /dev/vdb
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Attempting to detach device vdb from instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:48:52 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:48:52 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:48:52 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:48:52 user nova-compute[71654]:   <serial>dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb</serial>
Apr 11 20:48:52 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:48:52 user nova-compute[71654]: </disk>
Apr 11 20:48:52 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:48:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully detached device vdb from instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 from the persistent domain config.
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:48:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:48:52 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:48:52 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:48:52 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:48:52 user nova-compute[71654]:   <serial>dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb</serial>
Apr 11 20:48:52 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:48:52 user nova-compute[71654]: </disk>
Apr 11 20:48:52 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246133.196057, 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:48:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully detached device vdb from instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 from the live domain config.
Apr 11 20:48:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKEJwFIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:48:53 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updated VIF entry in instance network info cache for port 91830629-fa39-4a76-9eba-4b33f2f66b7a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [{"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d6808-662e-4182-9280-b72981f808b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:48:53 user nova-compute[71654]: No targets found.
Apr 11 20:48:53 user nova-compute[71654]: iSNS:
Apr 11 20:48:53 user nova-compute[71654]: No targets found.
Apr 11 20:48:53 user nova-compute[71654]: STATIC:
Apr 11 20:48:53 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb
Apr 11 20:48:53 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:48:53 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:48:53 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:48:53 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:48:53 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:48:53 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:48:53 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:48:53 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:48:53 user nova-compute[71654]: FIRMWARE:
Apr 11 20:48:53 user nova-compute[71654]: No targets found.
Apr 11 20:48:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:48:53 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:48:53 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-578db123-92da-4bb1-93c4-154415583048 req-cce014cc-5e3e-465f-a7cd-ac3a4689343b service nova] Releasing lock "refresh_cache-0d4bccf7-341f-4bc4-ade1-cb948f6dd950" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0f9cf0-f3e5-4bcc-ae53-e0f7406b385e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da1101-691e-4394-bd7b-6a4ed13431fa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:48:53 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:48:53 user nova-compute[71654]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)
Apr 11 20:48:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:48:53 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:48:53 user nova-compute[71654]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb (non-flash)
Apr 11 20:48:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb382d24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e5218-1d66-41ea-858e-4aa35143b86a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f93a500-e34a-451f-aa11-548b01b3f1ee]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc0b30-a929-4ffe-9333-192232f37954]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a5da7e-0e94-48bb-a636-9bc0aa8604e7]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43dce37-b013-40b7-9ed9-5ccb3d7068d7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dde6eb-0134-41e8-85bb-7f5211bd5923]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260]
Apr 11 20:48:53 user nova-compute[71654]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb, portal: 172.16.0.220,3260] successful.
Apr 11 20:48:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbf6749e-e4d5-4de5-bd7d-7cf4ada254fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9372549-214d-4ea2-9370-8d66dbcd90d6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] <== disconnect_volume: return (319ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:48:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG nova.objects.instance [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'flavor' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9393fa4c-0870-4e31-a172-f2f02fbe8ce5 tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.820s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:54 user nova-compute[71654]: INFO nova.compute.manager [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Terminating instance
Apr 11 20:48:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-05be9dd2-2e97-4af7-ad56-de32df0a819b req-4b999f23-9885-4bf1-9ce3-62269cba8fcc service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-unplugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:48:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Instance destroyed successfully.
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid dadac585-3a7c-40d8-a335-fc2603588c28 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-120119093',display_name='tempest-ServerActionsTestJSON-server-1788631209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-120119093',id=3,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-fbudrhc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=dadac585-3a7c-40d8-a335-fc2603588c28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "address": "fa:16:3e:76:b1:a7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21864ca9-0a", "ovs_interfaceid": "21864ca9-0ae0-4591-a5bc-fac2428743cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_vif [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21864ca9-0a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:55 user nova-compute[71654]: INFO os_vif [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:b1:a7,bridge_name='br-int',has_traffic_filtering=True,id=21864ca9-0ae0-4591-a5bc-fac2428743cb,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21864ca9-0a')
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYsMFtAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:48:55 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd7535f-4507-413f-8523-f32be89e777b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:48:55 user nova-compute[71654]: No targets found.
Apr 11 20:48:55 user nova-compute[71654]: iSNS:
Apr 11 20:48:55 user nova-compute[71654]: No targets found.
Apr 11 20:48:55 user nova-compute[71654]: STATIC:
Apr 11 20:48:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609
Apr 11 20:48:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:48:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:48:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:48:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:48:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:48:55 user nova-compute[71654]: FIRMWARE:
Apr 11 20:48:55 user nova-compute[71654]: No targets found.
Apr 11 20:48:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:48:55 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:48:55 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba28f52a-6824-4bad-a9ad-e510bad056df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a53f092-2ca3-4b8e-aab4-e2f9ad72a0d0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:48:55 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:48:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:48:55 user nova-compute[71654]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 (non-flash)
Apr 11 20:48:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb383a67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ef55fa-3adc-48c1-87da-9884cac89c32]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbacaf37-a1ae-4884-9231-dbbfb1cb0c8f]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b37d17-92bd-441b-890f-48df848cf280]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[df304210-b944-4cbb-beca-17c0c1368387]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc98b84-5d83-45ab-90ff-cf28652fef25]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f04f77-6fd5-4247-8956-4662436f681d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260]
Apr 11 20:48:55 user nova-compute[71654]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609, portal: 172.16.0.220,3260] successful.
Apr 11 20:48:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfcd112c-1532-4aa6-9cc4-b03448a34609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78fc2c-0d92-47a9-aa1a-e84341580267]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (278ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:48:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Deleting instance files /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_del
Apr 11 20:48:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Deletion of /opt/stack/data/nova/instances/dadac585-3a7c-40d8-a335-fc2603588c28_del complete
Apr 11 20:48:55 user nova-compute[71654]: INFO nova.compute.manager [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 11 20:48:55 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:48:55 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:48:56 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:48:56 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Took 0.83 seconds to deallocate network for instance.
Apr 11 20:48:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Acquiring lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] Lock "dadac585-3a7c-40d8-a335-fc2603588c28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] No waiting events found dispatching network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:48:56 user nova-compute[71654]: WARNING nova.compute.manager [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received unexpected event network-vif-plugged-21864ca9-0ae0-4591-a5bc-fac2428743cb for instance with vm_state active and task_state deleting.
Apr 11 20:48:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-b1051142-58f0-450b-bb68-8aa5c74f3615 req-022c08ea-96c5-4dd5-91b5-3babbc93c038 service nova] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Received event network-vif-deleted-21864ca9-0ae0-4591-a5bc-fac2428743cb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:48:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:48:57 user nova-compute[71654]: INFO nova.compute.manager [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Took 0.84 seconds to detach 1 volumes for instance.
Apr 11 20:48:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:48:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:48:57 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:48:57 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:48:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:48:57 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Deleted allocations for instance dadac585-3a7c-40d8-a335-fc2603588c28
Apr 11 20:48:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63bba872-43bf-4606-abe1-c0259081f464 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "dadac585-3a7c-40d8-a335-fc2603588c28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.310s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:09 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:49:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:09 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:49:09 user nova-compute[71654]: INFO nova.compute.claims [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Claim successful on node user
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246135.182073, dadac585-3a7c-40d8-a335-fc2603588c28 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:10 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] VM Stopped (Lifecycle Event)
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2001afc4-3079-4e97-8b56-fdd33da536bf None None] [instance: dadac585-3a7c-40d8-a335-fc2603588c28] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:49:10 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.policy [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:49:10 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Creating image(s)
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk 1073741824" returned: 0 in 0.050s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:10 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Successfully created port: 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Cannot resize image /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'migration_context' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Ensure instance console log exists: /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Successfully updated port: 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquired lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.compute.manager [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-changed-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG nova.compute.manager [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Refreshing instance network info cache due to event network-changed-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:49:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Acquiring lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updating instance_info_cache with network_info: [{"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Releasing lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Instance network_info: |[{"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Acquired lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.neutron [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Refreshing network info cache for port 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Start _get_guest_xml network_info=[{"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:49:12 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:49:12 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-231989771',display_name='tempest-AttachVolumeNegativeTest-server-231989771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-231989771',id=25,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxqGSOT+nC8Y5GLekTT28NQqXKel5w/Nz8b0qa2ChUKgQlp/lJfRSaBMsnLRITHJ7B9e5AlqpL4GODcIHuKjxLf1m6dEsavIrti/LprkMSPYiA5nDdzyNhxE5IcGNkciQ==',key_name='tempest-keypair-319392662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-vf64e6rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=7d336b76-477f-48c0-aa96-21b5d40d1754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:49:12 user nova-compute[71654]:   <uuid>7d336b76-477f-48c0-aa96-21b5d40d1754</uuid>
Apr 11 20:49:12 user nova-compute[71654]:   <name>instance-00000019</name>
Apr 11 20:49:12 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:49:12 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:49:12 user nova-compute[71654]:   <metadata>
Apr 11 20:49:12 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:49:12 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:49:12 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeNegativeTest-server-231989771</nova:name>
Apr 11 20:49:12 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:49:12</nova:creationTime>
Apr 11 20:49:12 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:49:12 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:49:12 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:49:12 user nova-compute[71654]:       <nova:owner>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:user uuid="4f69b01612974865be4e1e1b6a9bd570">tempest-AttachVolumeNegativeTest-1901377641-project-member</nova:user>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:project uuid="db28134878ba46528b7d5012ff9c7aff">tempest-AttachVolumeNegativeTest-1901377641</nova:project>
Apr 11 20:49:12 user nova-compute[71654]:       </nova:owner>
Apr 11 20:49:12 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:49:12 user nova-compute[71654]:       <nova:ports>
Apr 11 20:49:12 user nova-compute[71654]:         <nova:port uuid="4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b">
Apr 11 20:49:12 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 20:49:12 user nova-compute[71654]:         </nova:port>
Apr 11 20:49:12 user nova-compute[71654]:       </nova:ports>
Apr 11 20:49:12 user nova-compute[71654]:     </nova:instance>
Apr 11 20:49:12 user nova-compute[71654]:   </metadata>
Apr 11 20:49:12 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:49:12 user nova-compute[71654]:     <system>
Apr 11 20:49:12 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:49:12 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:49:12 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:49:12 user nova-compute[71654]:       <entry name="serial">7d336b76-477f-48c0-aa96-21b5d40d1754</entry>
Apr 11 20:49:12 user nova-compute[71654]:       <entry name="uuid">7d336b76-477f-48c0-aa96-21b5d40d1754</entry>
Apr 11 20:49:12 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:49:12 user nova-compute[71654]:     </system>
Apr 11 20:49:12 user nova-compute[71654]:   </sysinfo>
Apr 11 20:49:12 user nova-compute[71654]:   <os>
Apr 11 20:49:12 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:49:12 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:49:12 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:49:12 user nova-compute[71654]:   </os>
Apr 11 20:49:12 user nova-compute[71654]:   <features>
Apr 11 20:49:12 user nova-compute[71654]:     <acpi/>
Apr 11 20:49:12 user nova-compute[71654]:     <apic/>
Apr 11 20:49:12 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:49:12 user nova-compute[71654]:   </features>
Apr 11 20:49:12 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:49:12 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:49:12 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:49:12 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:49:12 user nova-compute[71654]:   </clock>
Apr 11 20:49:12 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:49:12 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:49:12 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:49:12 user nova-compute[71654]:   </cpu>
Apr 11 20:49:12 user nova-compute[71654]:   <devices>
Apr 11 20:49:12 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:49:12 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:49:12 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk"/>
Apr 11 20:49:12 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:49:12 user nova-compute[71654]:     </disk>
Apr 11 20:49:12 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:49:12 user nova-compute[71654]:       <mac address="fa:16:3e:cc:05:9e"/>
Apr 11 20:49:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:49:12 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:49:12 user nova-compute[71654]:       <target dev="tap4b4cc7e4-27"/>
Apr 11 20:49:12 user nova-compute[71654]:     </interface>
Apr 11 20:49:12 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:49:12 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/console.log" append="off"/>
Apr 11 20:49:12 user nova-compute[71654]:     </serial>
Apr 11 20:49:12 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:49:12 user nova-compute[71654]:     <video>
Apr 11 20:49:12 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:49:12 user nova-compute[71654]:     </video>
Apr 11 20:49:12 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:49:12 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:49:12 user nova-compute[71654]:     </rng>
Apr 11 20:49:12 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:49:12 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:49:12 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:49:12 user nova-compute[71654]:     </memballoon>
Apr 11 20:49:12 user nova-compute[71654]:   </devices>
Apr 11 20:49:12 user nova-compute[71654]: </domain>
Apr 11 20:49:12 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-231989771',display_name='tempest-AttachVolumeNegativeTest-server-231989771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-231989771',id=25,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxqGSOT+nC8Y5GLekTT28NQqXKel5w/Nz8b0qa2ChUKgQlp/lJfRSaBMsnLRITHJ7B9e5AlqpL4GODcIHuKjxLf1m6dEsavIrti/LprkMSPYiA5nDdzyNhxE5IcGNkciQ==',key_name='tempest-keypair-319392662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-vf64e6rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=7d336b76-477f-48c0-aa96-21b5d40d1754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG os_vif [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b4cc7e4-27, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b4cc7e4-27, col_values=(('external_ids', {'iface-id': '4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:05:9e', 'vm-uuid': '7d336b76-477f-48c0-aa96-21b5d40d1754'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:12 user nova-compute[71654]: INFO os_vif [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27')
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:cc:05:9e, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.neutron [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updated VIF entry in instance network info cache for port 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG nova.network.neutron [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updating instance_info_cache with network_info: [{"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-56a7cd50-4e8a-41ce-982c-3be769100947 req-070cffeb-e6ce-454a-9c18-8948153fb8d2 service nova] Releasing lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] No waiting events found dispatching network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:13 user nova-compute[71654]: WARNING nova.compute.manager [req-7fb47352-8f5a-4682-85b5-1821dc9e71dd req-3090474b-7528-446c-9cfc-abcc2e4301b4 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received unexpected event network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance with vm_state building and task_state spawning.
Apr 11 20:49:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246155.9005706, 7d336b76-477f-48c0-aa96-21b5d40d1754 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:15 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] VM Resumed (Lifecycle Event)
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:49:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Instance spawned successfully.
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:15 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246155.9025831, 7d336b76-477f-48c0-aa96-21b5d40d1754 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:15 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] VM Started (Lifecycle Event)
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:15 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:49:16 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:49:16 user nova-compute[71654]: INFO nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 11 20:49:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] No waiting events found dispatching network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:16 user nova-compute[71654]: WARNING nova.compute.manager [req-4083e20d-0acf-4d13-ab75-ecd9449b4eb5 req-479527c6-e4e7-4d6d-b522-099b83706113 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received unexpected event network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance with vm_state building and task_state spawning.
Apr 11 20:49:16 user nova-compute[71654]: INFO nova.compute.manager [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Took 6.16 seconds to build instance.
Apr 11 20:49:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2d3fcbc3-cad6-4d73-9595-35d6e91f58d1 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.262s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:49:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'flavor' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:22 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Ignoring supplied device name: /dev/vdb
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:22 user nova-compute[71654]: INFO nova.compute.manager [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Attaching volume 1423fa0c-764d-4182-9bb0-e045da6bfb1a to /dev/vdb
Apr 11 20:49:22 user nova-compute[71654]: DEBUG os_brick.utils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd307e0-137a-49d9-9eea-57ea768c29fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f1d02-5ba4-4177-a281-399ee265e04e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd52079b-95dc-4344-b3b4-246fdbe24692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657fa22-cdbc-41b2-a9ee-473d4264e346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:49:22 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:49:22 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[de07b259-82e1-4361-a5c6-c68b75df531d]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG os_brick.utils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:49:22 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Updating existing volume attachment record: 74c2cb32-f2eb-48a6-b48d-1611ff25e0f5 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:49:23 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:24 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNTFQMXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:49:27 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:49:27 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:49:27 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b309ee-27c5-4357-b0d9-278e82ba0b0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:49:27 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e4991-c792-4c3f-b0ad-8355f112514c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a] added
Apr 11 20:49:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf6fb5-15d5-403e-b0ae-f9942277fd16]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606d702-025d-4344-baa7-584668f94b3c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNTFQMXf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNTFQMXf" returned: 0 in 0.035s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f5ade-59ab-4111-9886-340aa5dd8ea9]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PNTFQMXf'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ba965d-1d3c-4853-b967-e7fdcf57e55c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5624a9-942b-4451-9e59-44c0adc91694]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a53da-31d3-45fe-b1be-7a7e65a96428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260]
Apr 11 20:49:27 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260] successful.
Apr 11 20:49:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fae825-a9fb-43b5-b915-c41bd9ca2557]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f3979-1c3d-47e3-8d23-67477efaec49]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:27 user nova-compute[71654]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a (non-flash)
Apr 11 20:49:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:49:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:27 user nova-compute[71654]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a (non-flash)
Apr 11 20:49:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[50800a86-202f-4401-86ee-1dd30ad84ac2]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNTFQMXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:28 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:49:28 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=26.273006439208984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance dfd1ff89-55fd-454d-a98f-2cab0388b86c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:49:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26430623261626338', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430623261626338', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'flavor' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:49:29 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:49:29 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:49:29 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:49:29 user nova-compute[71654]:   <serial>1423fa0c-764d-4182-9bb0-e045da6bfb1a</serial>
Apr 11 20:49:29 user nova-compute[71654]: </disk>
Apr 11 20:49:29 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] No VIF found with MAC fa:16:3e:f6:10:c4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:49:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89501259-4aed-4b87-adb1-7ba0e7d3eaf2 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.031s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:49:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:33 user nova-compute[71654]: INFO nova.compute.manager [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Unrescuing
Apr 11 20:49:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:34 user nova-compute[71654]: WARNING nova.compute.manager [req-4c30629b-e205-4be5-97f6-6c4d995f5bb5 req-403956ea-b7b5-4965-ac8d-7e312943135c service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:49:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance destroyed successfully.
Apr 11 20:49:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:36 user nova-compute[71654]: WARNING nova.compute.manager [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:36 user nova-compute[71654]: WARNING nova.compute.manager [req-084b86de-e412-4a03-aa4d-748390cd6d61 req-3c7c29f1-21e5-4759-af71-ec459eaa835f service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:36 user nova-compute[71654]: INFO nova.compute.manager [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Detaching volume 1423fa0c-764d-4182-9bb0-e045da6bfb1a
Apr 11 20:49:36 user nova-compute[71654]: INFO nova.virt.block_device [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Attempting to driver detach volume 1423fa0c-764d-4182-9bb0-e045da6bfb1a from mountpoint /dev/vdb
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Attempting to detach device vdb from instance dfd1ff89-55fd-454d-a98f-2cab0388b86c from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:49:36 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:49:36 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:49:36 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:49:36 user nova-compute[71654]:   <serial>1423fa0c-764d-4182-9bb0-e045da6bfb1a</serial>
Apr 11 20:49:36 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:49:36 user nova-compute[71654]: </disk>
Apr 11 20:49:36 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully detached device vdb from instance dfd1ff89-55fd-454d-a98f-2cab0388b86c from the persistent domain config.
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfd1ff89-55fd-454d-a98f-2cab0388b86c from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:49:36 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:49:36 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 20:49:36 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:49:36 user nova-compute[71654]:   <serial>1423fa0c-764d-4182-9bb0-e045da6bfb1a</serial>
Apr 11 20:49:36 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:49:36 user nova-compute[71654]: </disk>
Apr 11 20:49:36 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:49:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246177.2512405, dfd1ff89-55fd-454d-a98f-2cab0388b86c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:49:37 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully detached device vdb from instance dfd1ff89-55fd-454d-a98f-2cab0388b86c from the live domain config.
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNTFQMXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:49:37 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4125057d-2ea7-4fc8-b125-ed1a61d4bedb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:49:37 user nova-compute[71654]: No targets found.
Apr 11 20:49:37 user nova-compute[71654]: iSNS:
Apr 11 20:49:37 user nova-compute[71654]: No targets found.
Apr 11 20:49:37 user nova-compute[71654]: STATIC:
Apr 11 20:49:37 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a
Apr 11 20:49:37 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:49:37 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:49:37 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:49:37 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:49:37 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:49:37 user nova-compute[71654]: FIRMWARE:
Apr 11 20:49:37 user nova-compute[71654]: No targets found.
Apr 11 20:49:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:49:37 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:49:37 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[52359fe5-f09b-469c-b17a-207a8eb8d1a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc0d018-9dc8-4981-8d11-160993c7d4b6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:37 user nova-compute[71654]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a (non-flash)
Apr 11 20:49:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:37 user nova-compute[71654]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a (non-flash)
Apr 11 20:49:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e6b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[168e0b6e-72e5-4bf0-af3a-88c34ca9b4be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0724c72-32a3-4ee0-bcf0-410a7d0fc491]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[72960f52-75de-49e8-aa0a-27f91690bfbb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63adba-9cab-463d-b1e1-b87300c7f180]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7873faa5-e30c-47fe-b94c-b37e751cff7c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5336272-301c-4dfa-80de-6af65862cf74]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260]
Apr 11 20:49:37 user nova-compute[71654]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a, portal: 172.16.0.220,3260] successful.
Apr 11 20:49:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9e5118-2def-4191-a4eb-cf4ee46b5293]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== disconnect_volume: return (283ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 05f0405b-e73d-4c84-8208-21194ab434d2 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246177.9595413, 05f0405b-e73d-4c84-8208-21194ab434d2 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:37 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Resumed (Lifecycle Event)
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-52341a2f-1227-4245-9137-e11937f60dc2 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:49:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246177.9633613, 05f0405b-e73d-4c84-8208-21194ab434d2 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:38 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Started (Lifecycle Event)
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:38 user nova-compute[71654]: WARNING nova.compute.manager [req-dd550169-44e1-437a-b136-2f2162167e8d req-da95f618-ffce-46d4-90c7-17dff43849f8 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state active and task_state None.
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'flavor' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5ab104d-f1dd-4bae-8e4f-6f29b370e7a3 tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.778s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.662s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:38 user nova-compute[71654]: INFO nova.compute.manager [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Terminating instance
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-vif-unplugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] No waiting events found dispatching network-vif-unplugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-f0fc2e98-ae6a-40e3-9dd7-ed11c62666a4 req-516c67b6-9007-447d-b114-a538553ef3a2 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-vif-unplugged-bd8a4a43-cc71-449b-8730-83aae6973e7f for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:49:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Instance destroyed successfully.
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lazy-loading 'resources' on Instance uuid dfd1ff89-55fd-454d-a98f-2cab0388b86c {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1075804271',display_name='tempest-VolumesSnapshotTestJSON-instance-1075804271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1075804271',id=23,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:47:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1982dc9f62644e2b8a541dc25854a6a9',ramdisk_id='',reservation_id='r-w7aogfng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-323644922',owner_user_name='tempest-VolumesSnapshotTestJSON-323644922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:47:38Z,user_data=None,user_id='94e4de8a85394d258268ff4304eccb2d',uuid=dfd1ff89-55fd-454d-a98f-2cab0388b86c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converting VIF {"id": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "address": "fa:16:3e:f6:10:c4", "network": {"id": "5986aa1d-df23-4d2b-9e22-0030e7716fd4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-814969417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1982dc9f62644e2b8a541dc25854a6a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8a4a43-cc", "ovs_interfaceid": "bd8a4a43-cc71-449b-8730-83aae6973e7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_vif [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd8a4a43-cc, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:49:39 user nova-compute[71654]: INFO os_vif [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:10:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd8a4a43-cc71-449b-8730-83aae6973e7f,network=Network(5986aa1d-df23-4d2b-9e22-0030e7716fd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8a4a43-cc')
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNTFQMXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:49:39 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a990aac-cc5c-4ded-b266-e1aa501fe1d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:49:39 user nova-compute[71654]: No targets found.
Apr 11 20:49:39 user nova-compute[71654]: iSNS:
Apr 11 20:49:39 user nova-compute[71654]: No targets found.
Apr 11 20:49:39 user nova-compute[71654]: STATIC:
Apr 11 20:49:39 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:49:39 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:49:39 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:49:39 user nova-compute[71654]: FIRMWARE:
Apr 11 20:49:39 user nova-compute[71654]: No targets found.
Apr 11 20:49:39 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:49:39 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:49:39 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1423fa0c-764d-4182-9bb0-e045da6bfb1a', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc5dae-399b-436c-a088-32222e253575]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5a9b1-03ad-44a9-b75f-55d28d2485ad]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:39 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:49:39 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e7feb0>, {}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Disconnecting from: [] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] <== disconnect_volume: return (80ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:49:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Deleting instance files /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c_del
Apr 11 20:49:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Deletion of /opt/stack/data/nova/instances/dfd1ff89-55fd-454d-a98f-2cab0388b86c_del complete
Apr 11 20:49:39 user nova-compute[71654]: INFO nova.compute.manager [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 11 20:49:39 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:49:39 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:39 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Took 0.47 seconds to deallocate network for instance.
Apr 11 20:49:39 user nova-compute[71654]: WARNING nova.volume.cinder [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Attachment 74c2cb32-f2eb-48a6-b48d-1611ff25e0f5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 74c2cb32-f2eb-48a6-b48d-1611ff25e0f5. (HTTP 404) (Request-ID: req-97c2b492-83b1-4625-ba71-2e635cc70b7f)
Apr 11 20:49:39 user nova-compute[71654]: INFO nova.compute.manager [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Took 0.02 seconds to detach 1 volumes for instance.
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:40 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Deleted allocations for instance dfd1ff89-55fd-454d-a98f-2cab0388b86c
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cdc5b2a4-63d6-4806-beeb-7a39d38be1fe tempest-VolumesSnapshotTestJSON-323644922 tempest-VolumesSnapshotTestJSON-323644922-project-member] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Acquiring lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] Lock "dfd1ff89-55fd-454d-a98f-2cab0388b86c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] No waiting events found dispatching network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:40 user nova-compute[71654]: WARNING nova.compute.manager [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received unexpected event network-vif-plugged-bd8a4a43-cc71-449b-8730-83aae6973e7f for instance with vm_state deleted and task_state None.
Apr 11 20:49:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-4ced442f-b9c2-4bb4-9d21-c595339164e8 req-ef95f964-bccc-4646-9f7d-924ec2566808 service nova] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Received event network-vif-deleted-bd8a4a43-cc71-449b-8730-83aae6973e7f {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:45 user nova-compute[71654]: INFO nova.compute.manager [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Terminating instance
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:45 user nova-compute[71654]: INFO nova.compute.manager [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Terminating instance
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-unplugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-unplugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-8c860ebf-e9ce-4694-85a6-695b824419bc req-1961a048-108d-45ad-81e6-c44ea60fa136 service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-unplugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:45 user nova-compute[71654]: DEBUG nova.compute.manager [req-28ce6fb1-a807-4e94-b7c2-88f2d3e071a3 req-4c62a2c5-25b6-4965-ba9a-f907f0569387 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-unplugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Instance destroyed successfully.
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lazy-loading 'resources' on Instance uuid 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-386756076',display_name='tempest-TestMinimumBasicScenario-server-386756076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-386756076',id=22,image_ref='d90454ee-0320-44ce-8994-3b5c9ecb8abb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgoaav2PRI5VZHoMp36RWFkGeyFgjBLkoPgkMM2Hm65e/3oSHCaUfGRxdpsPwOI/1U0NM4gRMKIb9KS0QfuAoBhUYfJpTYnlQ7qj7Mn/zb/HY5zoBAOJEN0G31zbRJyBg==',key_name='tempest-TestMinimumBasicScenario-1187350393',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd62a4c803247588716e71c25c62b05',ramdisk_id='',reservation_id='r-1z6fv609',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d90454ee-0320-44ce-8994-3b5c9ecb8abb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2142191059',owner_user_name='tempest-TestMinimumBasicScenario-2142191059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:47:07Z,user_data=None,user_id='0a70ed7ce13442e6b7f6f62b960520ad',uuid=0d4bccf7-341f-4bc4-ade1-cb948f6dd950,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converting VIF {"id": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "address": "fa:16:3e:42:3b:00", "network": {"id": "015d6542-ba34-4e59-8cbe-3f538cd1f769", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-80510238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd62a4c803247588716e71c25c62b05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91830629-fa", "ovs_interfaceid": "91830629-fa39-4a76-9eba-4b33f2f66b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG os_vif [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91830629-fa, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Instance destroyed successfully.
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'resources' on Instance uuid 9613dc9f-5683-4139-bbed-0c2a11c2dc31 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:46 user nova-compute[71654]: INFO os_vif [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:3b:00,bridge_name='br-int',has_traffic_filtering=True,id=91830629-fa39-4a76-9eba-4b33f2f66b7a,network=Network(015d6542-ba34-4e59-8cbe-3f538cd1f769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91830629-fa')
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Deleting instance files /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950_del
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Deletion of /opt/stack/data/nova/instances/0d4bccf7-341f-4bc4-ade1-cb948f6dd950_del complete
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1899891318',display_name='tempest-AttachVolumeTestJSON-server-1899891318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1899891318',id=14,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZ/L3XOwyEbGmWySI8k561qdgaWTPV0y+GiCidggM8TpIRL18LKb6ABj38myQNjVt6WfReg6SxzeDxfKNsBLreHa2wu6QvU7KOT26Nxkqban7jriXNPI40e3tpAzAVWA==',key_name='tempest-keypair-641505706',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-uwgcy5ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=9613dc9f-5683-4139-bbed-0c2a11c2dc31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "087e4499-cfde-448a-b093-08f4b879f946", "address": "fa:16:3e:1a:3b:8b", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap087e4499-cf", "ovs_interfaceid": "087e4499-cfde-448a-b093-08f4b879f946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG os_vif [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap087e4499-cf, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: INFO os_vif [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:3b:8b,bridge_name='br-int',has_traffic_filtering=True,id=087e4499-cfde-448a-b093-08f4b879f946,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap087e4499-cf')
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Deleting instance files /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31_del
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Deletion of /opt/stack/data/nova/instances/9613dc9f-5683-4139-bbed-0c2a11c2dc31_del complete
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.compute.manager [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 20:49:46 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.compute.manager [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 11 20:49:46 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:49:46 user nova-compute[71654]: INFO nova.compute.claims [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Claim successful on node user
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:47 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Took 0.68 seconds to deallocate network for instance.
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-80e43d60-d622-409e-a360-5157a5cc8876 req-53192d05-3a66-4472-a153-7e402ac8dc3f service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-deleted-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.307s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:49:47 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:49:47 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Took 1.18 seconds to deallocate network for instance.
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Acquiring lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] No waiting events found dispatching network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:47 user nova-compute[71654]: WARNING nova.compute.manager [req-34a43862-dc30-4ca3-b323-3de08e885747 req-e708a486-9dd2-43d6-8883-a1e20c98127b service nova] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Received unexpected event network-vif-plugged-91830629-fa39-4a76-9eba-4b33f2f66b7a for instance with vm_state deleted and task_state None.
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.policy [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:49:47 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Creating image(s)
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "/opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "/opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "/opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Acquiring lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] No waiting events found dispatching network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:47 user nova-compute[71654]: WARNING nova.compute.manager [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received unexpected event network-vif-plugged-087e4499-cfde-448a-b093-08f4b879f946 for instance with vm_state deleted and task_state None.
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-f36e12d3-61a9-4c8b-91ad-8d1f50f31437 req-f0bba971-1d16-4f38-9248-a6a57081ae79 service nova] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Received event network-vif-deleted-087e4499-cfde-448a-b093-08f4b879f946 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.155s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.323s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:47 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Deleted allocations for instance 0d4bccf7-341f-4bc4-ade1-cb948f6dd950
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.162s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk 1073741824" returned: 0 in 0.059s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6b5c778a-ee38-4aba-8d7c-27716afdf54f tempest-TestMinimumBasicScenario-2142191059 tempest-TestMinimumBasicScenario-2142191059-project-member] Lock "0d4bccf7-341f-4bc4-ade1-cb948f6dd950" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.990s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Successfully created port: a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:49:48 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Deleted allocations for instance 9613dc9f-5683-4139-bbed-0c2a11c2dc31
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Cannot resize image /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'migration_context' on Instance uuid 27573de4-b3dc-48ad-b1dc-11c3cb206670 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Ensure instance console log exists: /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7d8ba482-94d3-4d2f-8a9d-72cf11d127e0 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "9613dc9f-5683-4139-bbed-0c2a11c2dc31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Successfully updated port: a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-changed-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Refreshing instance network info cache due to event network-changed-a5b56921-0469-48f8-bbe7-b4106babb386. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Acquiring lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Instance network_info: |[{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Acquired lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.neutron [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Refreshing network info cache for port a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Start _get_guest_xml network_info=[{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:49:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:49:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1870482065',display_name='tempest-ServerActionsTestJSON-server-1870482065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1870482065',id=26,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-zflj9yhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=27573de4-b3dc-48ad-b1dc-11c3cb206670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_devices' on Instance uuid 27573de4-b3dc-48ad-b1dc-11c3cb206670 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:49:49 user nova-compute[71654]:   <uuid>27573de4-b3dc-48ad-b1dc-11c3cb206670</uuid>
Apr 11 20:49:49 user nova-compute[71654]:   <name>instance-0000001a</name>
Apr 11 20:49:49 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:49:49 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:49:49 user nova-compute[71654]:   <metadata>
Apr 11 20:49:49 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:49:49 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:49:49 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-1870482065</nova:name>
Apr 11 20:49:49 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:49:49</nova:creationTime>
Apr 11 20:49:49 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:49:49 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:49:49 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:49:49 user nova-compute[71654]:       <nova:owner>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:49:49 user nova-compute[71654]:       </nova:owner>
Apr 11 20:49:49 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:49:49 user nova-compute[71654]:       <nova:ports>
Apr 11 20:49:49 user nova-compute[71654]:         <nova:port uuid="a5b56921-0469-48f8-bbe7-b4106babb386">
Apr 11 20:49:49 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 20:49:49 user nova-compute[71654]:         </nova:port>
Apr 11 20:49:49 user nova-compute[71654]:       </nova:ports>
Apr 11 20:49:49 user nova-compute[71654]:     </nova:instance>
Apr 11 20:49:49 user nova-compute[71654]:   </metadata>
Apr 11 20:49:49 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:49:49 user nova-compute[71654]:     <system>
Apr 11 20:49:49 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:49:49 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:49:49 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:49:49 user nova-compute[71654]:       <entry name="serial">27573de4-b3dc-48ad-b1dc-11c3cb206670</entry>
Apr 11 20:49:49 user nova-compute[71654]:       <entry name="uuid">27573de4-b3dc-48ad-b1dc-11c3cb206670</entry>
Apr 11 20:49:49 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:49:49 user nova-compute[71654]:     </system>
Apr 11 20:49:49 user nova-compute[71654]:   </sysinfo>
Apr 11 20:49:49 user nova-compute[71654]:   <os>
Apr 11 20:49:49 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:49:49 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:49:49 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:49:49 user nova-compute[71654]:   </os>
Apr 11 20:49:49 user nova-compute[71654]:   <features>
Apr 11 20:49:49 user nova-compute[71654]:     <acpi/>
Apr 11 20:49:49 user nova-compute[71654]:     <apic/>
Apr 11 20:49:49 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:49:49 user nova-compute[71654]:   </features>
Apr 11 20:49:49 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:49:49 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:49:49 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:49:49 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:49:49 user nova-compute[71654]:   </clock>
Apr 11 20:49:49 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:49:49 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:49:49 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:49:49 user nova-compute[71654]:   </cpu>
Apr 11 20:49:49 user nova-compute[71654]:   <devices>
Apr 11 20:49:49 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:49:49 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:49:49 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk"/>
Apr 11 20:49:49 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:49:49 user nova-compute[71654]:     </disk>
Apr 11 20:49:49 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:49:49 user nova-compute[71654]:       <mac address="fa:16:3e:8d:ea:b7"/>
Apr 11 20:49:49 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:49:49 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:49:49 user nova-compute[71654]:       <target dev="tapa5b56921-04"/>
Apr 11 20:49:49 user nova-compute[71654]:     </interface>
Apr 11 20:49:49 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:49:49 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/console.log" append="off"/>
Apr 11 20:49:49 user nova-compute[71654]:     </serial>
Apr 11 20:49:49 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:49:49 user nova-compute[71654]:     <video>
Apr 11 20:49:49 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:49:49 user nova-compute[71654]:     </video>
Apr 11 20:49:49 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:49:49 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:49:49 user nova-compute[71654]:     </rng>
Apr 11 20:49:49 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:49:49 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:49:49 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:49:49 user nova-compute[71654]:     </memballoon>
Apr 11 20:49:49 user nova-compute[71654]:   </devices>
Apr 11 20:49:49 user nova-compute[71654]: </domain>
Apr 11 20:49:49 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1870482065',display_name='tempest-ServerActionsTestJSON-server-1870482065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1870482065',id=26,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-zflj9yhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=27573de4-b3dc-48ad-b1dc-11c3cb206670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG os_vif [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5b56921-04, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5b56921-04, col_values=(('external_ids', {'iface-id': 'a5b56921-0469-48f8-bbe7-b4106babb386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:ea:b7', 'vm-uuid': '27573de4-b3dc-48ad-b1dc-11c3cb206670'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:49 user nova-compute[71654]: INFO os_vif [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04')
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:49:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:8d:ea:b7, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updated VIF entry in instance network info cache for port a5b56921-0469-48f8-bbe7-b4106babb386. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a686268e-a21f-4c0a-87fd-99ce8c7a3d20 req-c8f74d80-4de5-46cd-bfa5-21a24315ee5e service nova] Releasing lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] No waiting events found dispatching network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:51 user nova-compute[71654]: WARNING nova.compute.manager [req-53cee908-7bc5-4254-b74c-166d5b7a71b4 req-1cbcc638-5f59-4eb5-bea5-997eada93e0d service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received unexpected event network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 for instance with vm_state building and task_state spawning.
Apr 11 20:49:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246193.1006956, 27573de4-b3dc-48ad-b1dc-11c3cb206670 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] VM Resumed (Lifecycle Event)
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Instance spawned successfully.
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246193.1018302, 27573de4-b3dc-48ad-b1dc-11c3cb206670 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] VM Started (Lifecycle Event)
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] No waiting events found dispatching network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:49:53 user nova-compute[71654]: WARNING nova.compute.manager [req-a51f026c-85b6-4141-a597-493295bf753e req-b3b021fb-e333-46bb-9038-488ed37ad3ce service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received unexpected event network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 for instance with vm_state building and task_state spawning.
Apr 11 20:49:53 user nova-compute[71654]: INFO nova.compute.manager [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Took 6.42 seconds to build instance.
Apr 11 20:49:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d934c41f-4f4b-420b-aa8d-bccbb69978aa tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.529s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:54 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246179.2657874, dfd1ff89-55fd-454d-a98f-2cab0388b86c => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:49:54 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] VM Stopped (Lifecycle Event)
Apr 11 20:49:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-74561e78-e182-46f0-a8ff-7a184c587448 None None] [instance: dfd1ff89-55fd-454d-a98f-2cab0388b86c] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:49:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:49:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:49:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:49:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:49:57 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:49:57 user nova-compute[71654]: INFO nova.compute.claims [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Claim successful on node user
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:49:58 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:49:58 user nova-compute[71654]: INFO nova.virt.block_device [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Booting with volume 5ad85d33-3ca5-44f2-86af-fa4d8044b37b at /dev/vda
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.policy [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2ee47ef8e2248dda212a623eab9915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b26639cfda0489797dd5c7fbfc75927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG os_brick.utils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f6af9a-060d-4d93-9482-cddc4f6c715d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba78ded-ab4c-4879-b2ff-a07e3b6cf9a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[10127b9e-c86f-4b07-9cf2-eab2c9d9f01c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9363bd3-3c90-4fc9-8abb-1419007a2525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:49:58 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:49:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a4c50-faa8-44c1-93b2-7a9b3f8a4810]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG os_brick.utils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:49:58 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating existing volume attachment record: 7cf98136-9655-46fa-a52e-149e114aa288 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:49:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Successfully created port: 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:49:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Successfully updated port: 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing instance network info cache due to event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance network_info: |[{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:50:00 user nova-compute[71654]: DEBUG nova.network.neutron [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:50:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updated VIF entry in instance network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:50:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:50:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b52428be-a1f4-4885-b51a-523d4c3fb207 req-65e6db2d-994f-40e6-a605-04e5b0ed88b7 service nova] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:50:01 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246186.1726906, 0d4bccf7-341f-4bc4-ade1-cb948f6dd950 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:50:01 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] VM Stopped (Lifecycle Event)
Apr 11 20:50:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a94fa164-b7bf-4659-bc3e-14361e41221a None None] [instance: 0d4bccf7-341f-4bc4-ade1-cb948f6dd950] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:01 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246186.2125204, 9613dc9f-5683-4139-bbed-0c2a11c2dc31 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:50:01 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] VM Stopped (Lifecycle Event)
Apr 11 20:50:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-15a03924-edcc-47a6-a109-3dbeb4b18756 None None] [instance: 9613dc9f-5683-4139-bbed-0c2a11c2dc31] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:50:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Creating image(s)
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Ensure instance console log exists: /opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Start _get_guest_xml network_info=[{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93e7b2c8-565c-49ec-8dc2-c8a1489eab6b', 'attached_at': '', 'detached_at': '', 'volume_id': '5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'serial': '5ad85d33-3ca5-44f2-86af-fa4d8044b37b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '7cf98136-9655-46fa-a52e-149e114aa288', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:50:02 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:50:02 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:50:02 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:50:02 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:50:02 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52890b2-a1f8-464b-b2df-9151818282df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:50:02 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b02c79a-3892-4809-a5bc-ea1a72347f51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b] added
Apr 11 20:50:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f445243f-6927-42fd-af77-a07c79306053]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b16c67-062e-4782-b76c-c3c1101f2ba0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edIDJEKz {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edIDJEKz" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9bd431-b444-409d-931a-bef0733dae9a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edIDJEKz'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfed70a-3c27-4499-82d9-6135ac3b525c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[41befc91-5b39-415a-9d20-8db13c296c57]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:50:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:50:02 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:50:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc781218-77ae-4560-ba1a-b6aa7c61cd2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]
Apr 11 20:50:03 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.
Apr 11 20:50:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7dab0-aed8-4ae7-bc0c-f9732449040f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7819262a-93d9-4741-ae7b-eb6c4645c9eb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:50:03 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:50:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:50:03 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:50:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00255e-769f-4d77-91c6-e42068c94a0e]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:50:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23338663236353934', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338663236353934', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-629010364',display_name='tempest-TestShelveInstance-server-629010364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-629010364',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAWJOf6I9rkJJXNLcDZX/Kb6Vxi27X1aA5/xNyjqDDLkYDF/zBtuVuX91idOh4pF42cJIilfyIyndvzyDZ0CJJ+uJagML47ITzNKfhOoXVlQ3i4YUlRBXFD0Cd/N8jq5A==',key_name='tempest-TestShelveInstance-176056509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b26639cfda0489797dd5c7fbfc75927',ramdisk_id='',reservation_id='r-xkiua7y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1168874819',owner_user_name='tempest-TestShelveInstance-1168874819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:49:58Z,user_data=None,user_id='f2ee47ef8e2248dda212a623eab9915b',uuid=93e7b2c8-565c-49ec-8dc2-c8a1489eab6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converting VIF {"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:50:04 user nova-compute[71654]:   <uuid>93e7b2c8-565c-49ec-8dc2-c8a1489eab6b</uuid>
Apr 11 20:50:04 user nova-compute[71654]:   <name>instance-0000001b</name>
Apr 11 20:50:04 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:50:04 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:50:04 user nova-compute[71654]:   <metadata>
Apr 11 20:50:04 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:50:04 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:50:04 user nova-compute[71654]:       <nova:name>tempest-TestShelveInstance-server-629010364</nova:name>
Apr 11 20:50:04 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:50:02</nova:creationTime>
Apr 11 20:50:04 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:50:04 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:50:04 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:50:04 user nova-compute[71654]:       <nova:owner>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:user uuid="f2ee47ef8e2248dda212a623eab9915b">tempest-TestShelveInstance-1168874819-project-member</nova:user>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:project uuid="2b26639cfda0489797dd5c7fbfc75927">tempest-TestShelveInstance-1168874819</nova:project>
Apr 11 20:50:04 user nova-compute[71654]:       </nova:owner>
Apr 11 20:50:04 user nova-compute[71654]:       <nova:ports>
Apr 11 20:50:04 user nova-compute[71654]:         <nova:port uuid="4eaf9038-98d7-4312-8905-dba89af13ae4">
Apr 11 20:50:04 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:50:04 user nova-compute[71654]:         </nova:port>
Apr 11 20:50:04 user nova-compute[71654]:       </nova:ports>
Apr 11 20:50:04 user nova-compute[71654]:     </nova:instance>
Apr 11 20:50:04 user nova-compute[71654]:   </metadata>
Apr 11 20:50:04 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:50:04 user nova-compute[71654]:     <system>
Apr 11 20:50:04 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:50:04 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:50:04 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:50:04 user nova-compute[71654]:       <entry name="serial">93e7b2c8-565c-49ec-8dc2-c8a1489eab6b</entry>
Apr 11 20:50:04 user nova-compute[71654]:       <entry name="uuid">93e7b2c8-565c-49ec-8dc2-c8a1489eab6b</entry>
Apr 11 20:50:04 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:50:04 user nova-compute[71654]:     </system>
Apr 11 20:50:04 user nova-compute[71654]:   </sysinfo>
Apr 11 20:50:04 user nova-compute[71654]:   <os>
Apr 11 20:50:04 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:50:04 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:50:04 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:50:04 user nova-compute[71654]:   </os>
Apr 11 20:50:04 user nova-compute[71654]:   <features>
Apr 11 20:50:04 user nova-compute[71654]:     <acpi/>
Apr 11 20:50:04 user nova-compute[71654]:     <apic/>
Apr 11 20:50:04 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:50:04 user nova-compute[71654]:   </features>
Apr 11 20:50:04 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:50:04 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:50:04 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:50:04 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:50:04 user nova-compute[71654]:   </clock>
Apr 11 20:50:04 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:50:04 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:50:04 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:50:04 user nova-compute[71654]:   </cpu>
Apr 11 20:50:04 user nova-compute[71654]:   <devices>
Apr 11 20:50:04 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:50:04 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:50:04 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:50:04 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:50:04 user nova-compute[71654]:       <serial>5ad85d33-3ca5-44f2-86af-fa4d8044b37b</serial>
Apr 11 20:50:04 user nova-compute[71654]:     </disk>
Apr 11 20:50:04 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:50:04 user nova-compute[71654]:       <mac address="fa:16:3e:f4:ee:64"/>
Apr 11 20:50:04 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:50:04 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:50:04 user nova-compute[71654]:       <target dev="tap4eaf9038-98"/>
Apr 11 20:50:04 user nova-compute[71654]:     </interface>
Apr 11 20:50:04 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:50:04 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/console.log" append="off"/>
Apr 11 20:50:04 user nova-compute[71654]:     </serial>
Apr 11 20:50:04 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:50:04 user nova-compute[71654]:     <video>
Apr 11 20:50:04 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:50:04 user nova-compute[71654]:     </video>
Apr 11 20:50:04 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:50:04 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:50:04 user nova-compute[71654]:     </rng>
Apr 11 20:50:04 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:50:04 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:50:04 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:50:04 user nova-compute[71654]:     </memballoon>
Apr 11 20:50:04 user nova-compute[71654]:   </devices>
Apr 11 20:50:04 user nova-compute[71654]: </domain>
Apr 11 20:50:04 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-629010364',display_name='tempest-TestShelveInstance-server-629010364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-629010364',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAWJOf6I9rkJJXNLcDZX/Kb6Vxi27X1aA5/xNyjqDDLkYDF/zBtuVuX91idOh4pF42cJIilfyIyndvzyDZ0CJJ+uJagML47ITzNKfhOoXVlQ3i4YUlRBXFD0Cd/N8jq5A==',key_name='tempest-TestShelveInstance-176056509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b26639cfda0489797dd5c7fbfc75927',ramdisk_id='',reservation_id='r-xkiua7y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1168874819',owner_user_name='tempest-TestShelveInstance-1168874819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:49:58Z,user_data=None,user_id='f2ee47ef8e2248dda212a623eab9915b',uuid=93e7b2c8-565c-49ec-8dc2-c8a1489eab6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converting VIF {"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG os_vif [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eaf9038-98, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4eaf9038-98, col_values=(('external_ids', {'iface-id': '4eaf9038-98d7-4312-8905-dba89af13ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ee:64', 'vm-uuid': '93e7b2c8-565c-49ec-8dc2-c8a1489eab6b'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:04 user nova-compute[71654]: INFO os_vif [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98')
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:50:04 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] No VIF found with MAC fa:16:3e:f4:ee:64, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:50:05 user nova-compute[71654]: WARNING nova.compute.manager [req-919c15ff-d715-4d0f-97e2-517f9f82b97a req-d7e4e263-823b-4a13-9fc0-60a7b9189e12 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state building and task_state spawning.
Apr 11 20:50:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246207.515457, 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] VM Resumed (Lifecycle Event)
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance spawned successfully.
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246207.51708, 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] VM Started (Lifecycle Event)
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Took 4.87 seconds to spawn the instance on the hypervisor.
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:50:07 user nova-compute[71654]: WARNING nova.compute.manager [req-c95b6c64-e0db-4e71-ab4e-76affbe9a77e req-8de2dfe4-4684-4ab3-b770-8c821f3e881a service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state building and task_state spawning.
Apr 11 20:50:07 user nova-compute[71654]: INFO nova.compute.manager [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Took 9.80 seconds to build instance.
Apr 11 20:50:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb97d6cc-9301-425c-a502-5ac6d59557c4 tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.904s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:16 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:50:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:23 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:25 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:25 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:28 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:50:28 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=26.296470642089844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:50:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:50:29 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:50:29 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:50:29 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:50:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updating instance_info_cache with network_info: [{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:34 user nova-compute[71654]: INFO nova.compute.manager [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] instance snapshotting
Apr 11 20:50:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Beginning live snapshot process
Apr 11 20:50:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqs8p4co2/9ea456fc599247899edf7252bb9c5a8a.delta 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqs8p4co2/9ea456fc599247899edf7252bb9c5a8a.delta 1073741824" returned: 0 in 0.055s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 20:50:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:50:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 20:50:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 20:50:36 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:50:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqs8p4co2/9ea456fc599247899edf7252bb9c5a8a.delta /opt/stack/data/nova/instances/snapshots/tmpqs8p4co2/9ea456fc599247899edf7252bb9c5a8a {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqs8p4co2/9ea456fc599247899edf7252bb9c5a8a.delta /opt/stack/data/nova/instances/snapshots/tmpqs8p4co2/9ea456fc599247899edf7252bb9c5a8a" returned: 0 in 0.503s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Snapshot extracted, beginning image upload
Apr 11 20:50:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:50:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Snapshot image upload complete
Apr 11 20:50:39 user nova-compute[71654]: INFO nova.compute.manager [None req-0c27965e-4c7c-43d2-b878-11ee97f47911 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Took 5.57 seconds to snapshot the instance on the hypervisor.
Apr 11 20:50:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:50:39 user nova-compute[71654]: INFO nova.compute.claims [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Claim successful on node user
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:50:40 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.policy [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c9f583cc98040bc822e1ac7e418aa98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d5e042ba34969a2bfdc0c89da11e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:50:40 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Creating image(s)
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "/opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "/opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "/opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk 1073741824" returned: 0 in 0.297s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.456s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking if we can resize image /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Successfully created port: df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Cannot resize image /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'migration_context' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Ensure instance console log exists: /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Successfully updated port: df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquired lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-changed-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Refreshing instance network info cache due to event network-changed-df89f670-8dc8-440c-b165-1864ccec6d2b. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Acquiring lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:50:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updating instance_info_cache with network_info: [{"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Releasing lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Instance network_info: |[{"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Acquired lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.neutron [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Refreshing network info cache for port df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Start _get_guest_xml network_info=[{"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:50:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:50:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-248702197',display_name='tempest-AttachVolumeTestJSON-server-248702197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-248702197',id=28,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LFqTUJ86qBSmeqQO1lrWwO+uCgMsoSXQidDgh1SeikH6h4Q1C3DQBzCRzlAXCIRNnIzC6RPtA2crTM5XdtUjbZsogjvbwXzftGF/y23Q0o2MxzRVYIuEKvuap1tGsow==',key_name='tempest-keypair-1071709161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-ukgflv17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=632ddb45-81b6-4107-ba86-98af48ee9481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'pci_devices' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:50:43 user nova-compute[71654]:   <uuid>632ddb45-81b6-4107-ba86-98af48ee9481</uuid>
Apr 11 20:50:43 user nova-compute[71654]:   <name>instance-0000001c</name>
Apr 11 20:50:43 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:50:43 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:50:43 user nova-compute[71654]:   <metadata>
Apr 11 20:50:43 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:50:43 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:50:43 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeTestJSON-server-248702197</nova:name>
Apr 11 20:50:43 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:50:43</nova:creationTime>
Apr 11 20:50:43 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:50:43 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:50:43 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:50:43 user nova-compute[71654]:       <nova:owner>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:user uuid="3c9f583cc98040bc822e1ac7e418aa98">tempest-AttachVolumeTestJSON-968541948-project-member</nova:user>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:project uuid="426d5e042ba34969a2bfdc0c89da11e8">tempest-AttachVolumeTestJSON-968541948</nova:project>
Apr 11 20:50:43 user nova-compute[71654]:       </nova:owner>
Apr 11 20:50:43 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:50:43 user nova-compute[71654]:       <nova:ports>
Apr 11 20:50:43 user nova-compute[71654]:         <nova:port uuid="df89f670-8dc8-440c-b165-1864ccec6d2b">
Apr 11 20:50:43 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 20:50:43 user nova-compute[71654]:         </nova:port>
Apr 11 20:50:43 user nova-compute[71654]:       </nova:ports>
Apr 11 20:50:43 user nova-compute[71654]:     </nova:instance>
Apr 11 20:50:43 user nova-compute[71654]:   </metadata>
Apr 11 20:50:43 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:50:43 user nova-compute[71654]:     <system>
Apr 11 20:50:43 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:50:43 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:50:43 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:50:43 user nova-compute[71654]:       <entry name="serial">632ddb45-81b6-4107-ba86-98af48ee9481</entry>
Apr 11 20:50:43 user nova-compute[71654]:       <entry name="uuid">632ddb45-81b6-4107-ba86-98af48ee9481</entry>
Apr 11 20:50:43 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:50:43 user nova-compute[71654]:     </system>
Apr 11 20:50:43 user nova-compute[71654]:   </sysinfo>
Apr 11 20:50:43 user nova-compute[71654]:   <os>
Apr 11 20:50:43 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:50:43 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:50:43 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:50:43 user nova-compute[71654]:   </os>
Apr 11 20:50:43 user nova-compute[71654]:   <features>
Apr 11 20:50:43 user nova-compute[71654]:     <acpi/>
Apr 11 20:50:43 user nova-compute[71654]:     <apic/>
Apr 11 20:50:43 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:50:43 user nova-compute[71654]:   </features>
Apr 11 20:50:43 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:50:43 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:50:43 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:50:43 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:50:43 user nova-compute[71654]:   </clock>
Apr 11 20:50:43 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:50:43 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:50:43 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:50:43 user nova-compute[71654]:   </cpu>
Apr 11 20:50:43 user nova-compute[71654]:   <devices>
Apr 11 20:50:43 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:50:43 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:50:43 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk"/>
Apr 11 20:50:43 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:50:43 user nova-compute[71654]:     </disk>
Apr 11 20:50:43 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:50:43 user nova-compute[71654]:       <mac address="fa:16:3e:fb:63:f6"/>
Apr 11 20:50:43 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:50:43 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:50:43 user nova-compute[71654]:       <target dev="tapdf89f670-8d"/>
Apr 11 20:50:43 user nova-compute[71654]:     </interface>
Apr 11 20:50:43 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:50:43 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/console.log" append="off"/>
Apr 11 20:50:43 user nova-compute[71654]:     </serial>
Apr 11 20:50:43 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:50:43 user nova-compute[71654]:     <video>
Apr 11 20:50:43 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:50:43 user nova-compute[71654]:     </video>
Apr 11 20:50:43 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:50:43 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:50:43 user nova-compute[71654]:     </rng>
Apr 11 20:50:43 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:50:43 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:50:43 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:50:43 user nova-compute[71654]:     </memballoon>
Apr 11 20:50:43 user nova-compute[71654]:   </devices>
Apr 11 20:50:43 user nova-compute[71654]: </domain>
Apr 11 20:50:43 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-248702197',display_name='tempest-AttachVolumeTestJSON-server-248702197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-248702197',id=28,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LFqTUJ86qBSmeqQO1lrWwO+uCgMsoSXQidDgh1SeikH6h4Q1C3DQBzCRzlAXCIRNnIzC6RPtA2crTM5XdtUjbZsogjvbwXzftGF/y23Q0o2MxzRVYIuEKvuap1tGsow==',key_name='tempest-keypair-1071709161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-ukgflv17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=632ddb45-81b6-4107-ba86-98af48ee9481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG os_vif [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf89f670-8d, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf89f670-8d, col_values=(('external_ids', {'iface-id': 'df89f670-8dc8-440c-b165-1864ccec6d2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:63:f6', 'vm-uuid': '632ddb45-81b6-4107-ba86-98af48ee9481'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:43 user nova-compute[71654]: INFO os_vif [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d')
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No VIF found with MAC fa:16:3e:fb:63:f6, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.neutron [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updated VIF entry in instance network info cache for port df89f670-8dc8-440c-b165-1864ccec6d2b. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG nova.network.neutron [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updating instance_info_cache with network_info: [{"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:50:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9b60a838-f885-4689-b6f2-d157a8d8f950 req-0b022e66-afc4-4687-943b-e2e79f6512e1 service nova] Releasing lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] No waiting events found dispatching network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:50:44 user nova-compute[71654]: WARNING nova.compute.manager [req-e08494a3-612a-48cb-a0fa-3eb54d8fb28c req-5a24a7e3-5e85-4d63-ac97-5920684e337b service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received unexpected event network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b for instance with vm_state building and task_state spawning.
Apr 11 20:50:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246246.7513127, 632ddb45-81b6-4107-ba86-98af48ee9481 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] VM Resumed (Lifecycle Event)
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Instance spawned successfully.
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] No waiting events found dispatching network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:50:46 user nova-compute[71654]: WARNING nova.compute.manager [req-aebc6324-a8ff-4f08-a9fe-173f46d1cb2a req-bfbaf61e-1f4e-422e-91c8-f1485ec771e7 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received unexpected event network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b for instance with vm_state building and task_state spawning.
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246246.75557, 632ddb45-81b6-4107-ba86-98af48ee9481 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] VM Started (Lifecycle Event)
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Took 6.29 seconds to spawn the instance on the hypervisor.
Apr 11 20:50:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:50:46 user nova-compute[71654]: INFO nova.compute.manager [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Took 7.08 seconds to build instance.
Apr 11 20:50:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7f60b92e-af18-4e3f-94d1-8dba84ea8dca tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:50:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:50:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:50:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:50:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:50:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:50:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-changed-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Refreshing instance network info cache due to event network-changed-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Acquiring lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Acquired lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:00 user nova-compute[71654]: DEBUG nova.network.neutron [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Refreshing network info cache for port 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updated VIF entry in instance network info cache for port 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updating instance_info_cache with network_info: [{"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7e2ede0e-72ad-475d-9830-0240206bbe4b req-8b62b2b0-a4e8-4caa-a410-a1369fe920b9 service nova] Releasing lock "refresh_cache-7d336b76-477f-48c0-aa96-21b5d40d1754" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG nova.objects.instance [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:02 user nova-compute[71654]: INFO nova.compute.manager [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Attaching volume d307d267-3ade-4892-9e38-572afec8c314 to /dev/vdb
Apr 11 20:51:02 user nova-compute[71654]: DEBUG os_brick.utils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f22ecfa-90af-4016-86f7-4e985133d846]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d653ff82-3717-4414-9591-01d92f9d1809]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[13308bf2-8a88-4828-9d3b-188f3013c5ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[60402963-f8d5-421a-b3d1-1ad566789f0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:51:02 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:51:02 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc97fe1-c1bd-4e5d-9f18-13175309a490]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG os_brick.utils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:02 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updating existing volume attachment record: 89187bac-b2a7-4882-a544-8c6557ab74d5 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:51:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScFxDsrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:07 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:07 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:07 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f326862a-5944-4078-9cf0-53abc1a5dc07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:51:07 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9eecac-e048-4766-b80f-8d6d677716cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314] added
Apr 11 20:51:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c2b7d-39ca-491c-bfff-1d26e2141acf]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf36a8-a154-4b8d-ac74-8c3c03c2369e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScFxDsrq {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScFxDsrq" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[856e4a19-ba04-4280-823e-a40be9efa4c4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScFxDsrq'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf6ac83-3762-42d0-bb6a-5bc2f7e8a25d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed2e1e-5b75-4f14-b895-cc8ab6dd615b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35bba4-8627-46a2-a98d-4175d409f080]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260]
Apr 11 20:51:07 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260] successful.
Apr 11 20:51:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef575b-e393-40f7-8911-49bdfed14649]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f79c13-e0e9-430d-b58d-c5a7860a0512]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 (non-flash)
Apr 11 20:51:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:07 user nova-compute[71654]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 (non-flash)
Apr 11 20:51:07 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a56fa55-0dff-4b8f-be55-a0277cf7b738]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:51:07 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScFxDsrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:51:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:08 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23038373132383337', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038373132383337', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:51:08 user nova-compute[71654]: DEBUG nova.objects.instance [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:51:08 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:51:08 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:51:08 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:51:08 user nova-compute[71654]:   <serial>d307d267-3ade-4892-9e38-572afec8c314</serial>
Apr 11 20:51:08 user nova-compute[71654]: </disk>
Apr 11 20:51:08 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:51:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:51:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:51:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:cc:05:9e, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:51:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-252dfd44-d187-43c0-8ef1-b4aa52b9b24c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.558s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:10 user nova-compute[71654]: INFO nova.compute.manager [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Detaching volume d307d267-3ade-4892-9e38-572afec8c314
Apr 11 20:51:10 user nova-compute[71654]: INFO nova.virt.block_device [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Attempting to driver detach volume d307d267-3ade-4892-9e38-572afec8c314 from mountpoint /dev/vdb
Apr 11 20:51:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Attempting to detach device vdb from instance 7d336b76-477f-48c0-aa96-21b5d40d1754 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:51:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:51:10 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:51:10 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:51:10 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:51:10 user nova-compute[71654]:   <serial>d307d267-3ade-4892-9e38-572afec8c314</serial>
Apr 11 20:51:10 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:51:10 user nova-compute[71654]: </disk>
Apr 11 20:51:10 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:51:10 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully detached device vdb from instance 7d336b76-477f-48c0-aa96-21b5d40d1754 from the persistent domain config.
Apr 11 20:51:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d336b76-477f-48c0-aa96-21b5d40d1754 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:51:10 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:51:10 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:51:10 user nova-compute[71654]:   <source dev="/dev/sdd"/>
Apr 11 20:51:10 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:51:10 user nova-compute[71654]:   <serial>d307d267-3ade-4892-9e38-572afec8c314</serial>
Apr 11 20:51:10 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:51:10 user nova-compute[71654]: </disk>
Apr 11 20:51:10 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246271.1309745, 7d336b76-477f-48c0-aa96-21b5d40d1754 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:51:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully detached device vdb from instance 7d336b76-477f-48c0-aa96-21b5d40d1754 from the live domain config.
Apr 11 20:51:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScFxDsrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2af13c-ee64-4bd2-8574-ef7acc5ea7ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:51:11 user nova-compute[71654]: No targets found.
Apr 11 20:51:11 user nova-compute[71654]: iSNS:
Apr 11 20:51:11 user nova-compute[71654]: No targets found.
Apr 11 20:51:11 user nova-compute[71654]: STATIC:
Apr 11 20:51:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b
Apr 11 20:51:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:51:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:51:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:51:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:51:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:51:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314
Apr 11 20:51:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:51:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:51:11 user nova-compute[71654]: FIRMWARE:
Apr 11 20:51:11 user nova-compute[71654]: No targets found.
Apr 11 20:51:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:51:11 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:51:11 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ad9976-fd60-4b36-9a7d-bda4e37f064f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66ea13-024f-46a3-a01a-d5ecf17a3714]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:11 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:11 user nova-compute[71654]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 (non-flash)
Apr 11 20:51:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:11 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:11 user nova-compute[71654]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 (non-flash)
Apr 11 20:51:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb382d2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd25a8-d18f-4363-b0f1-1486e5ed918b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c36e48a-7075-4f63-9558-f01afcdbe76a]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[352504f7-0ab6-4d63-916b-9476897d4f59]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4774f4-7fd2-4a47-92ae-4bb352c5d5ff]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b885613-0467-4ac2-8178-ef700ff40613]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d634d7-baa6-4a3c-acd0-728a8c68310f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260]
Apr 11 20:51:11 user nova-compute[71654]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314, portal: 172.16.0.220,3260] successful.
Apr 11 20:51:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307d267-3ade-4892-9e38-572afec8c314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfa675-0ae5-4fca-a8c4-21674d94374e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== disconnect_volume: return (285ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:51:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e0ca0b2c-5e99-479e-894c-027b906bcc83 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.610s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:18 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:19 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:21 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:51:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:23 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:51:27 user nova-compute[71654]: INFO nova.compute.claims [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Claim successful on node user
Apr 11 20:51:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:51:28 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.policy [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dce0b6fa6d9546c8a04b7a4a5f93e0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ad2f73c14141dd8f7aa0d6f6c747b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:51:28 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Creating image(s)
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk 1073741824" returned: 0 in 0.058s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Cannot resize image /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'migration_context' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Successfully created port: 6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Ensure instance console log exists: /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:51:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Successfully updated port: 6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing instance network info cache due to event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance network_info: |[{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.neutron [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Start _get_guest_xml network_info=[{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:51:30 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:30 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1225023406',display_name='tempest-ServerRescueNegativeTestJSON-server-1225023406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1225023406',id=29,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4x6uP246VWRPkKSeoaF0rKad7haM9o+g0vO55lyTBMphQrGzfiAPwPyJOIeXbxZxLBgRKOqIaGp/M0eiVeOUEpldUvWk5YlfA9kM4Hp1+g48Kwhly6qXWHqLhlF/xwtA==',key_name='tempest-keypair-440521057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-8g0g1nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=3be648d4-6469-4c11-a51b-06c3fb4c9a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'pci_devices' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:51:30 user nova-compute[71654]:   <uuid>3be648d4-6469-4c11-a51b-06c3fb4c9a6b</uuid>
Apr 11 20:51:30 user nova-compute[71654]:   <name>instance-0000001d</name>
Apr 11 20:51:30 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:51:30 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:51:30 user nova-compute[71654]:   <metadata>
Apr 11 20:51:30 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:51:30 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:51:30 user nova-compute[71654]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1225023406</nova:name>
Apr 11 20:51:30 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:51:30</nova:creationTime>
Apr 11 20:51:30 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:51:30 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:51:30 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:51:30 user nova-compute[71654]:       <nova:owner>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:user uuid="dce0b6fa6d9546c8a04b7a4a5f93e0c7">tempest-ServerRescueNegativeTestJSON-777351805-project-member</nova:user>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:project uuid="a2ad2f73c14141dd8f7aa0d6f6c747b0">tempest-ServerRescueNegativeTestJSON-777351805</nova:project>
Apr 11 20:51:30 user nova-compute[71654]:       </nova:owner>
Apr 11 20:51:30 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:51:30 user nova-compute[71654]:       <nova:ports>
Apr 11 20:51:30 user nova-compute[71654]:         <nova:port uuid="6cba1d9f-880d-4dbe-9315-db1ba21cb865">
Apr 11 20:51:30 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 20:51:30 user nova-compute[71654]:         </nova:port>
Apr 11 20:51:30 user nova-compute[71654]:       </nova:ports>
Apr 11 20:51:30 user nova-compute[71654]:     </nova:instance>
Apr 11 20:51:30 user nova-compute[71654]:   </metadata>
Apr 11 20:51:30 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:51:30 user nova-compute[71654]:     <system>
Apr 11 20:51:30 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:51:30 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:51:30 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:51:30 user nova-compute[71654]:       <entry name="serial">3be648d4-6469-4c11-a51b-06c3fb4c9a6b</entry>
Apr 11 20:51:30 user nova-compute[71654]:       <entry name="uuid">3be648d4-6469-4c11-a51b-06c3fb4c9a6b</entry>
Apr 11 20:51:30 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:51:30 user nova-compute[71654]:     </system>
Apr 11 20:51:30 user nova-compute[71654]:   </sysinfo>
Apr 11 20:51:30 user nova-compute[71654]:   <os>
Apr 11 20:51:30 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:51:30 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:51:30 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:51:30 user nova-compute[71654]:   </os>
Apr 11 20:51:30 user nova-compute[71654]:   <features>
Apr 11 20:51:30 user nova-compute[71654]:     <acpi/>
Apr 11 20:51:30 user nova-compute[71654]:     <apic/>
Apr 11 20:51:30 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:51:30 user nova-compute[71654]:   </features>
Apr 11 20:51:30 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:51:30 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:51:30 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:51:30 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:51:30 user nova-compute[71654]:   </clock>
Apr 11 20:51:30 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:51:30 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:51:30 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:51:30 user nova-compute[71654]:   </cpu>
Apr 11 20:51:30 user nova-compute[71654]:   <devices>
Apr 11 20:51:30 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:51:30 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:51:30 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk"/>
Apr 11 20:51:30 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:51:30 user nova-compute[71654]:     </disk>
Apr 11 20:51:30 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:51:30 user nova-compute[71654]:       <mac address="fa:16:3e:ae:c8:b4"/>
Apr 11 20:51:30 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:51:30 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:51:30 user nova-compute[71654]:       <target dev="tap6cba1d9f-88"/>
Apr 11 20:51:30 user nova-compute[71654]:     </interface>
Apr 11 20:51:30 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:51:30 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/console.log" append="off"/>
Apr 11 20:51:30 user nova-compute[71654]:     </serial>
Apr 11 20:51:30 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:51:30 user nova-compute[71654]:     <video>
Apr 11 20:51:30 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:51:30 user nova-compute[71654]:     </video>
Apr 11 20:51:30 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:51:30 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:51:30 user nova-compute[71654]:     </rng>
Apr 11 20:51:30 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:51:30 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:51:30 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:51:30 user nova-compute[71654]:     </memballoon>
Apr 11 20:51:30 user nova-compute[71654]:   </devices>
Apr 11 20:51:30 user nova-compute[71654]: </domain>
Apr 11 20:51:30 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1225023406',display_name='tempest-ServerRescueNegativeTestJSON-server-1225023406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1225023406',id=29,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4x6uP246VWRPkKSeoaF0rKad7haM9o+g0vO55lyTBMphQrGzfiAPwPyJOIeXbxZxLBgRKOqIaGp/M0eiVeOUEpldUvWk5YlfA9kM4Hp1+g48Kwhly6qXWHqLhlF/xwtA==',key_name='tempest-keypair-440521057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-8g0g1nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=3be648d4-6469-4c11-a51b-06c3fb4c9a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG os_vif [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cba1d9f-88, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cba1d9f-88, col_values=(('external_ids', {'iface-id': '6cba1d9f-880d-4dbe-9315-db1ba21cb865', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:c8:b4', 'vm-uuid': '3be648d4-6469-4c11-a51b-06c3fb4c9a6b'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:30 user nova-compute[71654]: INFO os_vif [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88')
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:ae:c8:b4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updated VIF entry in instance network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d117026a-d211-404c-baec-b78ebd0b6eb5 req-fb95a83a-412a-479f-bd29-ef6e6eb85557 service nova] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246294.0846732, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Resumed (Lifecycle Event)
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:34 user nova-compute[71654]: WARNING nova.compute.manager [req-0e6c4e5e-003a-417e-bec2-833ff073564a req-546536bc-1d06-499d-b3f4-680cc4847a8c service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state building and task_state spawning.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance spawned successfully.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:51:34 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:34 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7989MB free_disk=26.265789031982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:34 user nova-compute[71654]: WARNING nova.compute.manager [req-6a85343c-1ed2-4f2e-880c-a709e06863fa req-44bc047c-a8bb-4eee-842b-b2b0be124015 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state building and task_state spawning.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246294.0857737, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Started (Lifecycle Event)
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 632ddb45-81b6-4107-ba86-98af48ee9481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:51:34 user nova-compute[71654]: INFO nova.compute.manager [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Took 6.74 seconds to build instance.
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dbc3a5fb-3406-4898-a6a5-ad63546a74c1 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.842s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-changed-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Refreshing instance network info cache due to event network-changed-a5b56921-0469-48f8-bbe7-b4106babb386. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Acquiring lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Acquired lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Refreshing network info cache for port a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updated VIF entry in instance network info cache for port a5b56921-0469-48f8-bbe7-b4106babb386. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a916aef8-4c0e-4961-8415-9c3ca2f717f3 req-0c9ee5e7-669d-40c0-9d23-a67355edc781 service nova] Releasing lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:40 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:51:40 user nova-compute[71654]: INFO nova.compute.claims [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Claim successful on node user
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:51:41 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:51:41 user nova-compute[71654]: INFO nova.virt.block_device [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Booting with volume 2e9baedf-a70c-41a1-8578-21a40984963e at /dev/vda
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.policy [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7736d32586e949e4839f826f18994a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c94dce35b4883940b8399d6d0ba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f13a99e-4b70-4ca9-8c04-9165efe87bc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf927fe-2a8b-4a27-abdc-bd5e1acdbabb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688184c-0883-4ef5-9a5b-7f147db47c7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ebc60-0b3e-492d-898c-e3a4db0787be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:51:41 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba2b3e8-87b1-4cb5-9a75-e2e24245a730]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating existing volume attachment record: d768f9e4-2944-48ff-91e1-6eee4f42c201 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:51:42 user nova-compute[71654]: INFO nova.compute.claims [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Claim successful on node user
Apr 11 20:51:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Successfully created port: 87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:51:42 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:51:42 user nova-compute[71654]: INFO nova.virt.block_device [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Booting with volume-backed-image 5eb5099b-ba97-47ac-833b-8ebacdc3051a at /dev/vda
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.policy [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d5cb62cc3844248be2e4456d970ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf8fe34838426ea05060463458e5e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:51:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Successfully updated port: 87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-changed-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.compute.manager [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Refreshing instance network info cache due to event network-changed-87a70211-de9a-40c1-b767-97cff2871ab3. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Acquiring lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Successfully created port: bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance network_info: |[{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Acquired lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:43 user nova-compute[71654]: DEBUG nova.network.neutron [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Refreshing network info cache for port 87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updated VIF entry in instance network info cache for port 87a70211-de9a-40c1-b767-97cff2871ab3. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-610f72ed-7291-4691-88d8-f4b5cc553abe req-63edcc27-abfe-4ba8-a5cf-f8ada6a545b9 service nova] Releasing lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Successfully updated port: bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-changed-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Refreshing instance network info cache due to event network-changed-bc598d8b-b02e-429d-895b-c553ab0a415a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Acquiring lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updating instance_info_cache with network_info: [{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance network_info: |[{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Acquired lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Refreshing network info cache for port bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updated VIF entry in instance network info cache for port bc598d8b-b02e-429d-895b-c553ab0a415a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updating instance_info_cache with network_info: [{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-be52b4c5-ba38-486a-bfb2-1407e3c48c96 req-631f024f-459b-4d50-a6a8-b267acae0d07 service nova] Releasing lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:51:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Creating image(s)
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Ensure instance console log exists: /opt/stack/data/nova/instances/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Start _get_guest_xml network_info=[{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6', 'attached_at': '', 'detached_at': '', 'volume_id': '2e9baedf-a70c-41a1-8578-21a40984963e', 'serial': '2e9baedf-a70c-41a1-8578-21a40984963e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'd768f9e4-2944-48ff-91e1-6eee4f42c201', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:51:46 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:46 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:46 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:46 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:46 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6674397-96e6-4b69-9843-3bf6b7fb6fa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:51:46 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d9052f-334f-4d70-bc43-058e2cf25e37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e] added
Apr 11 20:51:46 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e351463-40ae-4e08-a47e-0d706e757692]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[339f7e93-5a6d-4763-87dd-6e5e7ff52731]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOgjLMib {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOgjLMib" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b05cb-0fad-47a5-afb4-580066c64997]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eOgjLMib'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf162a2-0673-4762-b6a1-09d365cf4916]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6822087c-fd2c-4566-8c60-9a5abbee5f92]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7849f0f-757e-45e9-b2fa-8937bb634289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]
Apr 11 20:51:46 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.
Apr 11 20:51:46 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89bdd7b-40cb-4481-9ed4-8a15741dd635]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a55e70-15f1-4dcf-a712-61ab71abd070]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:46 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:46 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:46 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74814dd-45c9-4c32-a9ae-faad5a7c5af5]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:51:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23564316562336134', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564316562336134', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1177514325',display_name='tempest-ServerActionsTestJSON-server-1177514325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1177514325',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-ej100p75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=49dc4f46-eb33-4fc8-ba2a-59140b9a64c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_devices' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:51:47 user nova-compute[71654]:   <uuid>49dc4f46-eb33-4fc8-ba2a-59140b9a64c6</uuid>
Apr 11 20:51:47 user nova-compute[71654]:   <name>instance-0000001e</name>
Apr 11 20:51:47 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:51:47 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:51:47 user nova-compute[71654]:   <metadata>
Apr 11 20:51:47 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:51:47 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:51:47 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-1177514325</nova:name>
Apr 11 20:51:47 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:51:46</nova:creationTime>
Apr 11 20:51:47 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:51:47 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:51:47 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:51:47 user nova-compute[71654]:       <nova:owner>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:51:47 user nova-compute[71654]:       </nova:owner>
Apr 11 20:51:47 user nova-compute[71654]:       <nova:ports>
Apr 11 20:51:47 user nova-compute[71654]:         <nova:port uuid="87a70211-de9a-40c1-b767-97cff2871ab3">
Apr 11 20:51:47 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 20:51:47 user nova-compute[71654]:         </nova:port>
Apr 11 20:51:47 user nova-compute[71654]:       </nova:ports>
Apr 11 20:51:47 user nova-compute[71654]:     </nova:instance>
Apr 11 20:51:47 user nova-compute[71654]:   </metadata>
Apr 11 20:51:47 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:51:47 user nova-compute[71654]:     <system>
Apr 11 20:51:47 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:51:47 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:51:47 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:51:47 user nova-compute[71654]:       <entry name="serial">49dc4f46-eb33-4fc8-ba2a-59140b9a64c6</entry>
Apr 11 20:51:47 user nova-compute[71654]:       <entry name="uuid">49dc4f46-eb33-4fc8-ba2a-59140b9a64c6</entry>
Apr 11 20:51:47 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:51:47 user nova-compute[71654]:     </system>
Apr 11 20:51:47 user nova-compute[71654]:   </sysinfo>
Apr 11 20:51:47 user nova-compute[71654]:   <os>
Apr 11 20:51:47 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:51:47 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:51:47 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:51:47 user nova-compute[71654]:   </os>
Apr 11 20:51:47 user nova-compute[71654]:   <features>
Apr 11 20:51:47 user nova-compute[71654]:     <acpi/>
Apr 11 20:51:47 user nova-compute[71654]:     <apic/>
Apr 11 20:51:47 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:51:47 user nova-compute[71654]:   </features>
Apr 11 20:51:47 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:51:47 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:51:47 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:51:47 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:51:47 user nova-compute[71654]:   </clock>
Apr 11 20:51:47 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:51:47 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:51:47 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:51:47 user nova-compute[71654]:   </cpu>
Apr 11 20:51:47 user nova-compute[71654]:   <devices>
Apr 11 20:51:47 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:51:47 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:51:47 user nova-compute[71654]:       <source dev="/dev/sdd"/>
Apr 11 20:51:47 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:51:47 user nova-compute[71654]:       <serial>2e9baedf-a70c-41a1-8578-21a40984963e</serial>
Apr 11 20:51:47 user nova-compute[71654]:     </disk>
Apr 11 20:51:47 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:51:47 user nova-compute[71654]:       <mac address="fa:16:3e:f1:4a:c8"/>
Apr 11 20:51:47 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:51:47 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:51:47 user nova-compute[71654]:       <target dev="tap87a70211-de"/>
Apr 11 20:51:47 user nova-compute[71654]:     </interface>
Apr 11 20:51:47 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:51:47 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/console.log" append="off"/>
Apr 11 20:51:47 user nova-compute[71654]:     </serial>
Apr 11 20:51:47 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:51:47 user nova-compute[71654]:     <video>
Apr 11 20:51:47 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:51:47 user nova-compute[71654]:     </video>
Apr 11 20:51:47 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:51:47 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:51:47 user nova-compute[71654]:     </rng>
Apr 11 20:51:47 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:51:47 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:51:47 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:51:47 user nova-compute[71654]:     </memballoon>
Apr 11 20:51:47 user nova-compute[71654]:   </devices>
Apr 11 20:51:47 user nova-compute[71654]: </domain>
Apr 11 20:51:47 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1177514325',display_name='tempest-ServerActionsTestJSON-server-1177514325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1177514325',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-ej100p75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=49dc4f46-eb33-4fc8-ba2a-59140b9a64c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG os_vif [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87a70211-de, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87a70211-de, col_values=(('external_ids', {'iface-id': '87a70211-de9a-40c1-b767-97cff2871ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:4a:c8', 'vm-uuid': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:47 user nova-compute[71654]: INFO os_vif [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de')
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:51:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:f1:4a:c8, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5fa89e-84f1-49f9-a955-62e38e37ba93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94b1261-37b9-4a68-9bf4-cecd6e423742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[66822008-e8c9-4e20-8b4e-606a37b47fef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[230da364-8d8d-4e89-a025-7bb136b71ef7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:51:48 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:51:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae2f6f7-d2fd-4b99-a1b1-8e11bddc63fd]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updating existing volume attachment record: e5d18066-15a6-44a3-99e6-802e0b0991ab {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:49 user nova-compute[71654]: WARNING nova.compute.manager [req-5af5d174-fdda-4312-a9c6-b4ba529f12cb req-972b9642-2bef-4182-9344-89c283a0081b service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state building and task_state spawning.
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:50 user nova-compute[71654]: INFO nova.compute.manager [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Shelve offloading
Apr 11 20:51:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-unplugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-unplugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:50 user nova-compute[71654]: WARNING nova.compute.manager [req-934ce2b3-a96a-4a44-9306-adda25a255ee req-316e8e54-eae4-463e-8383-792c4125886f service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-unplugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state active and task_state shelving.
Apr 11 20:51:50 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance destroyed successfully.
Apr 11 20:51:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246311.2389736, 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] VM Resumed (Lifecycle Event)
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance spawned successfully.
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246311.240393, 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] VM Started (Lifecycle Event)
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:51 user nova-compute[71654]: WARNING nova.compute.manager [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state building and task_state spawning.
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing instance network info cache due to event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Took 5.23 seconds to spawn the instance on the hypervisor.
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:51 user nova-compute[71654]: INFO nova.compute.manager [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Took 10.54 seconds to build instance.
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5880b5da-2fad-476a-9c0f-ea9370d17ff1 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.640s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.network.neutron [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updated VIF entry in instance network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.network.neutron [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-94f13bab-499a-45c2-aab4-fec5203db9a4 req-a54f8b59-495a-4e0c-bf88-ce2e6d84ccc4 service nova] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance destroyed successfully.
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'resources' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-629010364',display_name='tempest-TestShelveInstance-server-629010364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-629010364',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAWJOf6I9rkJJXNLcDZX/Kb6Vxi27X1aA5/xNyjqDDLkYDF/zBtuVuX91idOh4pF42cJIilfyIyndvzyDZ0CJJ+uJagML47ITzNKfhOoXVlQ3i4YUlRBXFD0Cd/N8jq5A==',key_name='tempest-TestShelveInstance-176056509',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b26639cfda0489797dd5c7fbfc75927',ramdisk_id='',reservation_id='r-xkiua7y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1168874819',owner_user_name='tempest-TestShelveInstance-1168874819-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:50:08Z,user_data=None,user_id='f2ee47ef8e2248dda212a623eab9915b',uuid=93e7b2c8-565c-49ec-8dc2-c8a1489eab6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converting VIF {"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_vif [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eaf9038-98, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:52 user nova-compute[71654]: INFO os_vif [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98')
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:52 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de112c4-51fe-4529-86a3-b29c2f9d0071]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:51:52 user nova-compute[71654]: No targets found.
Apr 11 20:51:52 user nova-compute[71654]: iSNS:
Apr 11 20:51:52 user nova-compute[71654]: No targets found.
Apr 11 20:51:52 user nova-compute[71654]: STATIC:
Apr 11 20:51:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b
Apr 11 20:51:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:51:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:51:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:51:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:51:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:51:52 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:51:52 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:51:52 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:51:52 user nova-compute[71654]: FIRMWARE:
Apr 11 20:51:52 user nova-compute[71654]: No targets found.
Apr 11 20:51:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:51:52 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:51:52 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b35fa6-d757-4004-a860-5d4290aba227]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e358dbc-9bb1-4d73-aab2-d8c0763d8a83]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:52 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:52 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:52 user nova-compute[71654]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:51:52 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb4073e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:52 user nova-compute[71654]: WARNING nova.compute.manager [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state active and task_state shelving.
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing instance network info cache due to event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.network.neutron [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65068e4-1de0-4185-9647-4a62db2cce9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5481ed7d-e3b1-4b07-94bf-518e94597ca1]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa73d26-f9a6-472c-b2a9-344d8ef1a8fe]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc54f21-f71d-45c9-b52d-76a74c765ed8]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf1c50-064c-4750-babb-73557d1de691]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc756f72-054d-4ff5-8c1f-e965de9f2a4e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]
Apr 11 20:51:52 user nova-compute[71654]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.
Apr 11 20:51:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cdd8de-61d8-41d2-b819-4e7196ecc586]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] <== disconnect_volume: return (344ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:51:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Deleting instance files /opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b_del
Apr 11 20:51:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Deletion of /opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b_del complete
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updated VIF entry in instance network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": null, "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4eaf9038-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc83365d-dddb-4f97-9598-15daa57b5a24 req-33340b65-e5a4-4ecf-b31b-b38d34b45f0b service nova] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:51:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Creating image(s)
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Ensure instance console log exists: /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Start _get_guest_xml network_info=[{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ead4cb65-5fee-46c2-8e8a-3cb846e963b0', 'attached_at': '', 'detached_at': '', 'volume_id': '41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'serial': '41840788-b0a2-4ee3-a6c0-6bd063cc2f3b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'e5d18066-15a6-44a3-99e6-802e0b0991ab', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:51:53 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:53 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:51:53 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:53 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:51:53 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d0490b-7dcd-4134-a369-95d7ed9b40a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:51:53 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad2a0a-740a-45b1-8991-f3094b1f110b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b] added
Apr 11 20:51:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ab27f-70ac-4a9b-9d43-97fa04c85eae]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[83780321-4b08-49f1-ad96-4f3c6fe2333b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psxjPFVh {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psxjPFVh" returned: 0 in 0.030s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[632d7c1c-8f52-4f9c-bfa2-ea2c17df4747]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psxjPFVh'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f531f-d332-4049-a6f5-019aead0c90a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a8f06-9721-4434-ad51-219d7a916c91]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:53 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:53 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[07557dda-c798-45e6-b0f5-f0453001ede3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260]
Apr 11 20:51:53 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260] successful.
Apr 11 20:51:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e2798-6e46-49b2-8915-31c096944e48]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7635c3-14f5-49b9-9cfd-be0e78712732]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:53 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:53 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:51:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:51:53 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:51:53 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:51:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c7894-f955-4fa8-93c6-373edaf2bc25]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:51:53 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Deleted allocations for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'numa_topology' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1d1cf5cf-dfc4-4542-9f29-ec75e2c59dad tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.265s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23463613062626630', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463613062626630', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494251155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494251155',id=31,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-d1065dnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:43Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=ead4cb65-5fee-46c2-8e8a-3cb846e963b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'pci_devices' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:51:54 user nova-compute[71654]:   <uuid>ead4cb65-5fee-46c2-8e8a-3cb846e963b0</uuid>
Apr 11 20:51:54 user nova-compute[71654]:   <name>instance-0000001f</name>
Apr 11 20:51:54 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:51:54 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:51:54 user nova-compute[71654]:   <metadata>
Apr 11 20:51:54 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:51:54 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:51:54 user nova-compute[71654]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-494251155</nova:name>
Apr 11 20:51:54 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:51:53</nova:creationTime>
Apr 11 20:51:54 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:51:54 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:51:54 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:51:54 user nova-compute[71654]:       <nova:owner>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:user uuid="1d5cb62cc3844248be2e4456d970ccdf">tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member</nova:user>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:project uuid="85bf8fe34838426ea05060463458e5e0">tempest-ServerBootFromVolumeStableRescueTest-243239500</nova:project>
Apr 11 20:51:54 user nova-compute[71654]:       </nova:owner>
Apr 11 20:51:54 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:51:54 user nova-compute[71654]:       <nova:ports>
Apr 11 20:51:54 user nova-compute[71654]:         <nova:port uuid="bc598d8b-b02e-429d-895b-c553ab0a415a">
Apr 11 20:51:54 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:51:54 user nova-compute[71654]:         </nova:port>
Apr 11 20:51:54 user nova-compute[71654]:       </nova:ports>
Apr 11 20:51:54 user nova-compute[71654]:     </nova:instance>
Apr 11 20:51:54 user nova-compute[71654]:   </metadata>
Apr 11 20:51:54 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:51:54 user nova-compute[71654]:     <system>
Apr 11 20:51:54 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:51:54 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:51:54 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:51:54 user nova-compute[71654]:       <entry name="serial">ead4cb65-5fee-46c2-8e8a-3cb846e963b0</entry>
Apr 11 20:51:54 user nova-compute[71654]:       <entry name="uuid">ead4cb65-5fee-46c2-8e8a-3cb846e963b0</entry>
Apr 11 20:51:54 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:51:54 user nova-compute[71654]:     </system>
Apr 11 20:51:54 user nova-compute[71654]:   </sysinfo>
Apr 11 20:51:54 user nova-compute[71654]:   <os>
Apr 11 20:51:54 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:51:54 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:51:54 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:51:54 user nova-compute[71654]:   </os>
Apr 11 20:51:54 user nova-compute[71654]:   <features>
Apr 11 20:51:54 user nova-compute[71654]:     <acpi/>
Apr 11 20:51:54 user nova-compute[71654]:     <apic/>
Apr 11 20:51:54 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:51:54 user nova-compute[71654]:   </features>
Apr 11 20:51:54 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:51:54 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:51:54 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:51:54 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:51:54 user nova-compute[71654]:   </clock>
Apr 11 20:51:54 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:51:54 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:51:54 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:51:54 user nova-compute[71654]:   </cpu>
Apr 11 20:51:54 user nova-compute[71654]:   <devices>
Apr 11 20:51:54 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:51:54 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:51:54 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:51:54 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:51:54 user nova-compute[71654]:       <serial>41840788-b0a2-4ee3-a6c0-6bd063cc2f3b</serial>
Apr 11 20:51:54 user nova-compute[71654]:     </disk>
Apr 11 20:51:54 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:51:54 user nova-compute[71654]:       <mac address="fa:16:3e:e9:e3:aa"/>
Apr 11 20:51:54 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:51:54 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:51:54 user nova-compute[71654]:       <target dev="tapbc598d8b-b0"/>
Apr 11 20:51:54 user nova-compute[71654]:     </interface>
Apr 11 20:51:54 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:51:54 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/console.log" append="off"/>
Apr 11 20:51:54 user nova-compute[71654]:     </serial>
Apr 11 20:51:54 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:51:54 user nova-compute[71654]:     <video>
Apr 11 20:51:54 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:51:54 user nova-compute[71654]:     </video>
Apr 11 20:51:54 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:51:54 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:51:54 user nova-compute[71654]:     </rng>
Apr 11 20:51:54 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:51:54 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:51:54 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:51:54 user nova-compute[71654]:     </memballoon>
Apr 11 20:51:54 user nova-compute[71654]:   </devices>
Apr 11 20:51:54 user nova-compute[71654]: </domain>
Apr 11 20:51:54 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494251155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494251155',id=31,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-d1065dnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:43Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=ead4cb65-5fee-46c2-8e8a-3cb846e963b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG os_vif [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc598d8b-b0, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc598d8b-b0, col_values=(('external_ids', {'iface-id': 'bc598d8b-b02e-429d-895b-c553ab0a415a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:e3:aa', 'vm-uuid': 'ead4cb65-5fee-46c2-8e8a-3cb846e963b0'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:54 user nova-compute[71654]: INFO os_vif [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0')
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:51:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No VIF found with MAC fa:16:3e:e9:e3:aa, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:51:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:56 user nova-compute[71654]: WARNING nova.compute.manager [req-5b315405-81a4-49c9-ad4c-3d4c3b60bc54 req-56ce1bf5-6ff8-4e7e-a1a4-908fe32b6a13 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state building and task_state spawning.
Apr 11 20:51:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid f1d5f91c-afaa-456a-97e7-0460b1748d79 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 27573de4-b3dc-48ad-b1dc-11c3cb206670 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "05f0405b-e73d-4c84-8208-21194ab434d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "764a059b-9ded-4d53-b960-ced4abe4323d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "764a059b-9ded-4d53-b960-ced4abe4323d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "05f0405b-e73d-4c84-8208-21194ab434d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246318.115086, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Resumed (Lifecycle Event)
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance spawned successfully.
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246318.1182806, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Started (Lifecycle Event)
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Took 5.01 seconds to spawn the instance on the hypervisor.
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Took 16.33 seconds to build instance.
Apr 11 20:51:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ca83738-f89b-4ad1-9f7a-2766094caca8 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.441s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.235s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:58 user nova-compute[71654]: INFO nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:51:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:51:58 user nova-compute[71654]: DEBUG nova.compute.manager [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:51:58 user nova-compute[71654]: WARNING nova.compute.manager [req-46add2e9-ca79-4f65-891c-fa3e6a39ab12 req-bdead3cb-57e4-4774-b269-6d19dd622068 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state None.
Apr 11 20:51:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:00 user nova-compute[71654]: INFO nova.compute.manager [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Terminating instance
Apr 11 20:52:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-vif-unplugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] No waiting events found dispatching network-vif-unplugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-4a11058e-c48e-40ce-b2eb-20616f6f38d5 req-643c017a-23f1-4fb4-bbac-644a02512805 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-vif-unplugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:52:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Instance destroyed successfully.
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.objects.instance [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'resources' on Instance uuid 7d336b76-477f-48c0-aa96-21b5d40d1754 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-231989771',display_name='tempest-AttachVolumeNegativeTest-server-231989771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-231989771',id=25,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxqGSOT+nC8Y5GLekTT28NQqXKel5w/Nz8b0qa2ChUKgQlp/lJfRSaBMsnLRITHJ7B9e5AlqpL4GODcIHuKjxLf1m6dEsavIrti/LprkMSPYiA5nDdzyNhxE5IcGNkciQ==',key_name='tempest-keypair-319392662',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-vf64e6rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=7d336b76-477f-48c0-aa96-21b5d40d1754,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "address": "fa:16:3e:cc:05:9e", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b4cc7e4-27", "ovs_interfaceid": "4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG os_vif [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b4cc7e4-27, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:01 user nova-compute[71654]: INFO os_vif [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:05:9e,bridge_name='br-int',has_traffic_filtering=True,id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b4cc7e4-27')
Apr 11 20:52:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Deleting instance files /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754_del
Apr 11 20:52:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Deletion of /opt/stack/data/nova/instances/7d336b76-477f-48c0-aa96-21b5d40d1754_del complete
Apr 11 20:52:01 user nova-compute[71654]: INFO nova.compute.manager [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 20:52:01 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:52:01 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:52:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:02 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:52:02 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Took 0.75 seconds to deallocate network for instance.
Apr 11 20:52:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-vif-deleted-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:02 user nova-compute[71654]: INFO nova.compute.manager [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Neutron deleted interface 4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b; detaching it from the instance and deleting it from the info cache
Apr 11 20:52:02 user nova-compute[71654]: DEBUG nova.network.neutron [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:52:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-7f498a58-20a4-477f-8dae-1244b5eeb2d2 req-a393001b-58ec-4078-92c9-4766d2b32e87 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Detach interface failed, port_id=4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b, reason: Instance 7d336b76-477f-48c0-aa96-21b5d40d1754 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:52:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:03 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Deleted allocations for instance 7d336b76-477f-48c0-aa96-21b5d40d1754
Apr 11 20:52:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-05255f9b-cd55-4d35-bd36-88006b2f97cf tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received event network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Acquiring lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] Lock "7d336b76-477f-48c0-aa96-21b5d40d1754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] No waiting events found dispatching network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:52:03 user nova-compute[71654]: WARNING nova.compute.manager [req-921f05ca-adcf-4915-a965-4f3b95477890 req-de35d0f6-9567-4956-b546-3a2c290260a1 service nova] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Received unexpected event network-vif-plugged-4b4cc7e4-2782-4655-9d7e-6cbe8f75e02b for instance with vm_state deleted and task_state None.
Apr 11 20:52:05 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246310.9610398, 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:52:05 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] VM Stopped (Lifecycle Event)
Apr 11 20:52:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-68980fe3-5185-4951-aba4-f14b1030bb57 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:52:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:16 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246321.7444773, 7d336b76-477f-48c0-aa96-21b5d40d1754 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:52:16 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] VM Stopped (Lifecycle Event)
Apr 11 20:52:16 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7a75f2fb-8e6e-4856-acee-895cbc8e0d07 None None] [instance: 7d336b76-477f-48c0-aa96-21b5d40d1754] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:52:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:20 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:52:23 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:25 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:52:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:52:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7837MB free_disk=26.25347900390625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-changed-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Refreshing instance network info cache due to event network-changed-df89f670-8dc8-440c-b165-1864ccec6d2b. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Acquiring lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Acquired lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Refreshing network info cache for port df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 632ddb45-81b6-4107-ba86-98af48ee9481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updated VIF entry in instance network info cache for port df89f670-8dc8-440c-b165-1864ccec6d2b. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updating instance_info_cache with network_info: [{"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5b015917-fa22-4f9c-bcbb-0cb067e041f3 req-daab0ad3-c005-4679-8eb6-b352dab070eb service nova] Releasing lock "refresh_cache-632ddb45-81b6-4107-ba86-98af48ee9481" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:52:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG nova.objects.instance [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:32 user nova-compute[71654]: INFO nova.compute.manager [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attaching volume 6cd64c2f-7416-438c-9b82-dc46f784381f to /dev/vdb
Apr 11 20:52:32 user nova-compute[71654]: DEBUG os_brick.utils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac627c-0113-4424-b44b-d2dee8661f7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[192efcb4-0e9b-476b-be25-e0462a41d0d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c693e6-6732-4c75-bdeb-ad9dd9435b52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b485717f-3ca3-4a2e-9551-a6feb5a22226]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:52:33 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:52:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebbba5-a802-4c49-b8ac-a635b7a4dd43]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG os_brick.utils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:52:33 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updating existing volume attachment record: d176fef6-6888-45bc-9988-cafc65f2104f {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:52:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRiADYed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:52:37 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:52:37 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:52:37 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b06f81b-daf7-4560-b7ff-2f5687d97585]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:52:37 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7513e9-c5d4-46b7-acba-05021f6a2714]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f] added
Apr 11 20:52:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f5a05b-713d-4592-b52b-346e0314d106]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa0ccf-54d5-49e3-99a2-ab220f987a89]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRiADYed {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRiADYed" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6872c252-0026-4f8b-bd79-68f2481d475f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRiADYed'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22ef6a-f10a-4d9f-847d-e9fc5af14239]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f9102-04ed-4ae1-bdda-69e479ebb56a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f71103-609b-455d-86fa-c7de29b5b97f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260]
Apr 11 20:52:37 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260] successful.
Apr 11 20:52:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7dba6b-c170-4ba5-9ddd-cf7187156890]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a862a787-c7aa-464a-95a9-6ce586d41dfe]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:37 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f884efd0-a17f-43e1-b078-431224948f96]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRiADYed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23164303830306264', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164303830306264', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG nova.objects.instance [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:52:38 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:52:38 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:52:38 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:52:38 user nova-compute[71654]:   <serial>6cd64c2f-7416-438c-9b82-dc46f784381f</serial>
Apr 11 20:52:38 user nova-compute[71654]: </disk>
Apr 11 20:52:38 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No VIF found with MAC fa:16:3e:fb:63:f6, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:52:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-adc46e60-f7e7-48b6-9e6c-9bff51fd5cf4 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.101s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:40 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:41 user nova-compute[71654]: INFO nova.compute.manager [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attaching volume 76633014-3a8e-4034-9681-70b222a6053c to /dev/vdc
Apr 11 20:52:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ccd42-a7dc-4f28-89f9-6178ae33e6e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a11ba00-c53e-4137-b4fb-77d32e56aa77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf836336-48fe-4019-b4c5-8fe61453bc59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c74a8d8-e88c-4c90-baa9-3b926cecd4e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:52:41 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:52:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b1b84-8150-4d11-9ac0-7df5fd0ce3c1]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updating existing volume attachment record: 96317067-921c-4e99-94d8-caa17a9aa0ad {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:52:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTerbQOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:52:45 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:52:45 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:52:45 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d663e510-c8cf-4cbc-bc2a-282967b82450]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:52:45 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee9931-63fb-4493-8277-aa6a9619cce5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c] added
Apr 11 20:52:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[042df52b-f745-4c45-997b-dc3ad9559573]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1fd97c-b936-4dd4-a5ea-95a3dae544a7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTerbQOo {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTerbQOo" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e9029-b4ae-4d10-bf57-45f1c0b33c46]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTerbQOo'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd677f8-18b6-478f-9f72-af66bd558f76]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d035dc2f-5cbb-4674-9ef2-7da643be7f20]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d6706c-d32b-4fb5-ba1d-314bfe41775f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260]
Apr 11 20:52:45 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260] successful.
Apr 11 20:52:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bb2809-3df1-4979-9daa-c9410afbbaa5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[39790455-f16f-4a8b-8f39-f5b3314cddec]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)
Apr 11 20:52:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:45 user nova-compute[71654]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)
Apr 11 20:52:45 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[81525600-2b9a-4a40-859c-20411f0481a5]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:45 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTerbQOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23934346665383665', 'path': '/dev/sdf'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934346665383665', 'path': '/dev/sdf'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:52:46 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:52:46 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:52:46 user nova-compute[71654]:   <target dev="vdc" bus="virtio"/>
Apr 11 20:52:46 user nova-compute[71654]:   <serial>76633014-3a8e-4034-9681-70b222a6053c</serial>
Apr 11 20:52:46 user nova-compute[71654]: </disk>
Apr 11 20:52:46 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:52:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:52:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:52:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:52:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] No VIF found with MAC fa:16:3e:fb:63:f6, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:52:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5fee869b-4623-4934-b73c-971ea6f6b61e tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.216s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:48 user nova-compute[71654]: INFO nova.compute.manager [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Detaching volume 6cd64c2f-7416-438c-9b82-dc46f784381f
Apr 11 20:52:48 user nova-compute[71654]: INFO nova.virt.block_device [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attempting to driver detach volume 6cd64c2f-7416-438c-9b82-dc46f784381f from mountpoint /dev/vdb
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Attempting to detach device vdb from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:52:48 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:52:48 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:52:48 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:52:48 user nova-compute[71654]:   <serial>6cd64c2f-7416-438c-9b82-dc46f784381f</serial>
Apr 11 20:52:48 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:52:48 user nova-compute[71654]: </disk>
Apr 11 20:52:48 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:52:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully detached device vdb from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the persistent domain config.
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:52:48 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:52:48 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:52:48 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:52:48 user nova-compute[71654]:   <serial>6cd64c2f-7416-438c-9b82-dc46f784381f</serial>
Apr 11 20:52:48 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:52:48 user nova-compute[71654]: </disk>
Apr 11 20:52:48 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246368.5457246, 632ddb45-81b6-4107-ba86-98af48ee9481 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:52:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully detached device vdb from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the live domain config.
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRiADYed', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:52:48 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8566a5d-373d-463f-9a58-44f55a97a24c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:52:48 user nova-compute[71654]: No targets found.
Apr 11 20:52:48 user nova-compute[71654]: iSNS:
Apr 11 20:52:48 user nova-compute[71654]: No targets found.
Apr 11 20:52:48 user nova-compute[71654]: STATIC:
Apr 11 20:52:48 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c
Apr 11 20:52:48 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:48 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:48 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f
Apr 11 20:52:48 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:48 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:48 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:52:48 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:48 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:48 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:52:48 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:48 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:48 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:52:48 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:48 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:48 user nova-compute[71654]: FIRMWARE:
Apr 11 20:52:48 user nova-compute[71654]: No targets found.
Apr 11 20:52:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:52:48 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:52:48 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77e18a-6ea8-45fd-8cee-6748d3c0df26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0b391d-4653-4a47-93f1-e215117056d6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)
Apr 11 20:52:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f (non-flash)
Apr 11 20:52:48 user nova-compute[71654]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)
Apr 11 20:52:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb403f8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb1f22a-2341-425a-b8e8-819f036f25c9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a8aa4-da15-446d-a617-abd3b8c8c83c]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[265829ec-1e54-4225-a8d8-6574ef87c416]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b037ee-4c1f-4044-bb7a-dda5d68d59bc]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f3a65-4abe-4908-9460-524895c7015c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e8fb3-e8fb-4d4d-948f-85bf341ac79a]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260]
Apr 11 20:52:48 user nova-compute[71654]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f, portal: 172.16.0.220,3260] successful.
Apr 11 20:52:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd64c2f-7416-438c-9b82-dc46f784381f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a393148e-08f3-43b6-81a5-1d0eb33479ad]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== disconnect_volume: return (354ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:52:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:52:49 user nova-compute[71654]: DEBUG nova.objects.instance [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-82c8b3e6-c3fd-4cfd-adab-00bf726813f5 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:50 user nova-compute[71654]: INFO nova.compute.manager [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Detaching volume 76633014-3a8e-4034-9681-70b222a6053c
Apr 11 20:52:50 user nova-compute[71654]: INFO nova.virt.block_device [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Attempting to driver detach volume 76633014-3a8e-4034-9681-70b222a6053c from mountpoint /dev/vdc
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Attempting to detach device vdc from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:52:50 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:52:50 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:52:50 user nova-compute[71654]:   <target dev="vdc" bus="virtio"/>
Apr 11 20:52:50 user nova-compute[71654]:   <serial>76633014-3a8e-4034-9681-70b222a6053c</serial>
Apr 11 20:52:50 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 20:52:50 user nova-compute[71654]: </disk>
Apr 11 20:52:50 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:52:50 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully detached device vdc from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the persistent domain config.
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:52:50 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:52:50 user nova-compute[71654]:   <source dev="/dev/sdf"/>
Apr 11 20:52:50 user nova-compute[71654]:   <target dev="vdc" bus="virtio"/>
Apr 11 20:52:50 user nova-compute[71654]:   <serial>76633014-3a8e-4034-9681-70b222a6053c</serial>
Apr 11 20:52:50 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 20:52:50 user nova-compute[71654]: </disk>
Apr 11 20:52:50 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246370.9378698, 632ddb45-81b6-4107-ba86-98af48ee9481 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:52:50 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully detached device vdc from instance 632ddb45-81b6-4107-ba86-98af48ee9481 from the live domain config.
Apr 11 20:52:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTerbQOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:52:50 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:52:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d7a9d-6b94-46d8-ace1-13aea3f0847e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:52:50 user nova-compute[71654]: No targets found.
Apr 11 20:52:50 user nova-compute[71654]: iSNS:
Apr 11 20:52:50 user nova-compute[71654]: No targets found.
Apr 11 20:52:50 user nova-compute[71654]: STATIC:
Apr 11 20:52:50 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c
Apr 11 20:52:50 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:50 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:50 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:52:50 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:50 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:50 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:52:50 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:50 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:50 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:52:50 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:52:50 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:52:50 user nova-compute[71654]: FIRMWARE:
Apr 11 20:52:50 user nova-compute[71654]: No targets found.
Apr 11 20:52:50 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:52:50 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:52:50 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d766ba-367b-4531-ae96-342de04428f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b034c320-adbc-4f5d-abc1-6bbb68ce4829]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:51 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:51 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:51 user nova-compute[71654]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)
Apr 11 20:52:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:52:51 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:52:51 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:52:51 user nova-compute[71654]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c (non-flash)
Apr 11 20:52:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb40588790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c'): ({'sdf'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Removing single pathed devices sdf {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd87f9-0790-4719-97a0-575d457eefb0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a835088f-0cd3-4b0d-9ad8-2ca4c8ca6c22]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Flushing IO for device /dev/sdf {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0c8b3-44b2-4b4a-8124-4cd4c68a22d2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7d35d2-b1b6-436d-91db-4e50d27a9572]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7229dae-1a0d-41af-9938-a1c7224d5fa5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ab2b61-a5cd-4a0b-80f5-6429ec3dde17]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260]
Apr 11 20:52:51 user nova-compute[71654]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c, portal: 172.16.0.220,3260] successful.
Apr 11 20:52:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76633014-3a8e-4034-9681-70b222a6053c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[809cce6f-dfd6-4b2a-ad9b-8b46dd482099]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] <== disconnect_volume: return (301ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'flavor' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d83bb8f9-8ee2-47ab-ac33-4b03c63352a8 tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.727s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:53 user nova-compute[71654]: INFO nova.compute.manager [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Terminating instance
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-vif-unplugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] No waiting events found dispatching network-vif-unplugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-6d408027-a40a-4330-b1eb-20be0c079e3a req-219b7956-4ab8-4dfa-a321-b893ad545e3e service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-vif-unplugged-df89f670-8dc8-440c-b165-1864ccec6d2b for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:52:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Instance destroyed successfully.
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lazy-loading 'resources' on Instance uuid 632ddb45-81b6-4107-ba86-98af48ee9481 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-248702197',display_name='tempest-AttachVolumeTestJSON-server-248702197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-248702197',id=28,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LFqTUJ86qBSmeqQO1lrWwO+uCgMsoSXQidDgh1SeikH6h4Q1C3DQBzCRzlAXCIRNnIzC6RPtA2crTM5XdtUjbZsogjvbwXzftGF/y23Q0o2MxzRVYIuEKvuap1tGsow==',key_name='tempest-keypair-1071709161',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:50:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='426d5e042ba34969a2bfdc0c89da11e8',ramdisk_id='',reservation_id='r-ukgflv17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-968541948',owner_user_name='tempest-AttachVolumeTestJSON-968541948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c9f583cc98040bc822e1ac7e418aa98',uuid=632ddb45-81b6-4107-ba86-98af48ee9481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converting VIF {"id": "df89f670-8dc8-440c-b165-1864ccec6d2b", "address": "fa:16:3e:fb:63:f6", "network": {"id": "f87b05c6-655f-40f5-9d5d-73525169adaa", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-383440949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "426d5e042ba34969a2bfdc0c89da11e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89f670-8d", "ovs_interfaceid": "df89f670-8dc8-440c-b165-1864ccec6d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG os_vif [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf89f670-8d, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:53 user nova-compute[71654]: INFO os_vif [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:63:f6,bridge_name='br-int',has_traffic_filtering=True,id=df89f670-8dc8-440c-b165-1864ccec6d2b,network=Network(f87b05c6-655f-40f5-9d5d-73525169adaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89f670-8d')
Apr 11 20:52:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Deleting instance files /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481_del
Apr 11 20:52:53 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Deletion of /opt/stack/data/nova/instances/632ddb45-81b6-4107-ba86-98af48ee9481_del complete
Apr 11 20:52:53 user nova-compute[71654]: INFO nova.compute.manager [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 20:52:53 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:52:53 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:52:55 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Took 1.24 seconds to deallocate network for instance.
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-d2df9951-ce7c-456c-84d8-628c891333d0 req-7aa738d0-1e6d-493d-bb04-44d291975b3d service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-vif-deleted-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received event network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Acquiring lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] Lock "632ddb45-81b6-4107-ba86-98af48ee9481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] No waiting events found dispatching network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:52:55 user nova-compute[71654]: WARNING nova.compute.manager [req-035094ed-9379-4e94-9c33-65abf9ed3797 req-3944bb96-871c-40a9-a07b-c1f5dce45723 service nova] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Received unexpected event network-vif-plugged-df89f670-8dc8-440c-b165-1864ccec6d2b for instance with vm_state deleted and task_state None.
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:55 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Deleted allocations for instance 632ddb45-81b6-4107-ba86-98af48ee9481
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6266ca6c-834d-47e1-b2d0-786f1a3d2d3c tempest-AttachVolumeTestJSON-968541948 tempest-AttachVolumeTestJSON-968541948-project-member] Lock "632ddb45-81b6-4107-ba86-98af48ee9481" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:55 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:52:55 user nova-compute[71654]: INFO nova.compute.claims [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Claim successful on node user
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:52:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.policy [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f69b01612974865be4e1e1b6a9bd570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db28134878ba46528b7d5012ff9c7aff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:52:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Creating image(s)
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "/opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk 1073741824" returned: 0 in 0.050s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Successfully created port: 0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Cannot resize image /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'migration_context' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Ensure instance console log exists: /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Successfully updated port: 0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquired lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-changed-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Refreshing instance network info cache due to event network-changed-0c429f6b-6a13-4752-ab77-35aad97b9a10. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Acquiring lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:52:57 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updating instance_info_cache with network_info: [{"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Releasing lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Instance network_info: |[{"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Acquired lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.neutron [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Refreshing network info cache for port 0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Start _get_guest_xml network_info=[{"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:52:58 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:52:58 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1708531122',display_name='tempest-AttachVolumeNegativeTest-server-1708531122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1708531122',id=32,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9M4nnLv9Kfngmmqa7wkotIEWs8NxuvYlnAPRxw7BkkUknV89fssNUDjI1CbZKjVpD+GtYJIY+uSuPWmyuAoezhPKAnxJuD6Sj0KDjy1vzY/LdFc26BOZVKvfXugfj6Zw==',key_name='tempest-keypair-603118687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-b04pm830',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'pci_devices' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:52:58 user nova-compute[71654]:   <uuid>a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073</uuid>
Apr 11 20:52:58 user nova-compute[71654]:   <name>instance-00000020</name>
Apr 11 20:52:58 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:52:58 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:52:58 user nova-compute[71654]:   <metadata>
Apr 11 20:52:58 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:52:58 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:52:58 user nova-compute[71654]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1708531122</nova:name>
Apr 11 20:52:58 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:52:58</nova:creationTime>
Apr 11 20:52:58 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:52:58 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:52:58 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:52:58 user nova-compute[71654]:       <nova:owner>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:user uuid="4f69b01612974865be4e1e1b6a9bd570">tempest-AttachVolumeNegativeTest-1901377641-project-member</nova:user>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:project uuid="db28134878ba46528b7d5012ff9c7aff">tempest-AttachVolumeNegativeTest-1901377641</nova:project>
Apr 11 20:52:58 user nova-compute[71654]:       </nova:owner>
Apr 11 20:52:58 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:52:58 user nova-compute[71654]:       <nova:ports>
Apr 11 20:52:58 user nova-compute[71654]:         <nova:port uuid="0c429f6b-6a13-4752-ab77-35aad97b9a10">
Apr 11 20:52:58 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:52:58 user nova-compute[71654]:         </nova:port>
Apr 11 20:52:58 user nova-compute[71654]:       </nova:ports>
Apr 11 20:52:58 user nova-compute[71654]:     </nova:instance>
Apr 11 20:52:58 user nova-compute[71654]:   </metadata>
Apr 11 20:52:58 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:52:58 user nova-compute[71654]:     <system>
Apr 11 20:52:58 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:52:58 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:52:58 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:52:58 user nova-compute[71654]:       <entry name="serial">a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073</entry>
Apr 11 20:52:58 user nova-compute[71654]:       <entry name="uuid">a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073</entry>
Apr 11 20:52:58 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:52:58 user nova-compute[71654]:     </system>
Apr 11 20:52:58 user nova-compute[71654]:   </sysinfo>
Apr 11 20:52:58 user nova-compute[71654]:   <os>
Apr 11 20:52:58 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:52:58 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:52:58 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:52:58 user nova-compute[71654]:   </os>
Apr 11 20:52:58 user nova-compute[71654]:   <features>
Apr 11 20:52:58 user nova-compute[71654]:     <acpi/>
Apr 11 20:52:58 user nova-compute[71654]:     <apic/>
Apr 11 20:52:58 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:52:58 user nova-compute[71654]:   </features>
Apr 11 20:52:58 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:52:58 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:52:58 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:52:58 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:52:58 user nova-compute[71654]:   </clock>
Apr 11 20:52:58 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:52:58 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:52:58 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:52:58 user nova-compute[71654]:   </cpu>
Apr 11 20:52:58 user nova-compute[71654]:   <devices>
Apr 11 20:52:58 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:52:58 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:52:58 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk"/>
Apr 11 20:52:58 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:52:58 user nova-compute[71654]:     </disk>
Apr 11 20:52:58 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:52:58 user nova-compute[71654]:       <mac address="fa:16:3e:9e:6d:2d"/>
Apr 11 20:52:58 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:52:58 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:52:58 user nova-compute[71654]:       <target dev="tap0c429f6b-6a"/>
Apr 11 20:52:58 user nova-compute[71654]:     </interface>
Apr 11 20:52:58 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:52:58 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/console.log" append="off"/>
Apr 11 20:52:58 user nova-compute[71654]:     </serial>
Apr 11 20:52:58 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:52:58 user nova-compute[71654]:     <video>
Apr 11 20:52:58 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:52:58 user nova-compute[71654]:     </video>
Apr 11 20:52:58 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:52:58 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:52:58 user nova-compute[71654]:     </rng>
Apr 11 20:52:58 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:52:58 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:52:58 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:52:58 user nova-compute[71654]:     </memballoon>
Apr 11 20:52:58 user nova-compute[71654]:   </devices>
Apr 11 20:52:58 user nova-compute[71654]: </domain>
Apr 11 20:52:58 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1708531122',display_name='tempest-AttachVolumeNegativeTest-server-1708531122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1708531122',id=32,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9M4nnLv9Kfngmmqa7wkotIEWs8NxuvYlnAPRxw7BkkUknV89fssNUDjI1CbZKjVpD+GtYJIY+uSuPWmyuAoezhPKAnxJuD6Sj0KDjy1vzY/LdFc26BOZVKvfXugfj6Zw==',key_name='tempest-keypair-603118687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-b04pm830',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG os_vif [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c429f6b-6a, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c429f6b-6a, col_values=(('external_ids', {'iface-id': '0c429f6b-6a13-4752-ab77-35aad97b9a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:6d:2d', 'vm-uuid': 'a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:58 user nova-compute[71654]: INFO os_vif [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a')
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:9e:6d:2d, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.neutron [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updated VIF entry in instance network info cache for port 0c429f6b-6a13-4752-ab77-35aad97b9a10. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG nova.network.neutron [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updating instance_info_cache with network_info: [{"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:52:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-87b290b6-275a-4097-a735-0f8cad7a79ea req-a05c7383-71c1-4894-bc2d-4d0946e1daff service nova] Releasing lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:52:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] No waiting events found dispatching network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:52:59 user nova-compute[71654]: WARNING nova.compute.manager [req-8e85c600-dd46-4a6a-bd02-de7d154dd026 req-d43e6355-999d-49f0-8d6a-c09b40525e3e service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received unexpected event network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance with vm_state building and task_state spawning.
Apr 11 20:53:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:00 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246381.701253, a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] VM Resumed (Lifecycle Event)
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Instance spawned successfully.
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246381.7043674, a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] VM Started (Lifecycle Event)
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Took 5.28 seconds to spawn the instance on the hypervisor.
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:01 user nova-compute[71654]: INFO nova.compute.manager [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Took 6.01 seconds to build instance.
Apr 11 20:53:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a77db32a-e7c0-46c3-ab5f-39d5d244c812 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.092s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] No waiting events found dispatching network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:01 user nova-compute[71654]: WARNING nova.compute.manager [req-f6c6b937-66aa-43c9-8d95-faeb119a1323 req-103aca78-80ac-4c0b-b14c-df9afc5274b0 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received unexpected event network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance with vm_state active and task_state None.
Apr 11 20:53:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:08 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246373.7419708, 632ddb45-81b6-4107-ba86-98af48ee9481 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:08 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] VM Stopped (Lifecycle Event)
Apr 11 20:53:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-56cf18a0-119f-4dd0-bc09-081478afc44b None None] [instance: 632ddb45-81b6-4107-ba86-98af48ee9481] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing instance network info cache due to event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:53:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:53:19 user nova-compute[71654]: DEBUG nova.network.neutron [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updated VIF entry in instance network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:53:19 user nova-compute[71654]: DEBUG nova.network.neutron [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e831f9dc-7ba0-4f12-9c30-8a21063087fe req-41eba61e-cf9b-4852-9159-444efd86b101 service nova] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:20 user nova-compute[71654]: INFO nova.compute.manager [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Attaching volume 15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 to /dev/vdb
Apr 11 20:53:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af15201-74cd-4433-b4cf-746d2231e077]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[33204cdc-9670-4672-8071-9dad846e91c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[241460df-a7d7-4af4-b5b1-33cd92ddf93d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2627b1-c8a7-4e0f-99c7-b7c97646854b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:53:20 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:53:20 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[448cbcc3-d8f3-4cf6-85dd-d7b2d0420eae]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG os_brick.utils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:20 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating existing volume attachment record: 6a513ed8-a9f6-47ea-89ce-379918805c56 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:53:21 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:53:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emIpWroR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:24 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:24 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:24 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d5c8d-bf47-4d73-8ce6-7d1b3b3f6d98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:53:24 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e49fe7-fd90-4c4d-90e6-51fb3dc3fe3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230] added
Apr 11 20:53:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7be8c94-637f-4489-b13c-bdfc363949e9]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d850fd-4503-461e-9837-95a390bd9506]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emIpWroR {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emIpWroR" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1da9025-92d9-4732-b1dc-0ffa4ef18a58]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'emIpWroR'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[535c13ff-d429-4f93-95d8-c66242a242ae]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98eb5f-2139-417d-ae93-da7d8237dfb4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[003390b5-ab82-4d47-b3d9-dae67e4aa4f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260]
Apr 11 20:53:25 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260] successful.
Apr 11 20:53:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12aac01-027e-4736-a3e8-1ef806d05cd6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aceba68-a945-404a-b71d-2d90533c811f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:25 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:25 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c749ffa-76a0-4cc3-b2e8-4651254d6295]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emIpWroR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26134313035616634', 'path': '/dev/sde'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134313035616634', 'path': '/dev/sde'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:53:26 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:53:26 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:53:26 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:53:26 user nova-compute[71654]:   <serial>15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230</serial>
Apr 11 20:53:26 user nova-compute[71654]: </disk>
Apr 11 20:53:26 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:ae:c8:b4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c5da30cf-36a8-4efe-b7ec-069534b258fd tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.433s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:28 user nova-compute[71654]: INFO nova.compute.manager [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Rescuing
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:28 user nova-compute[71654]: WARNING nova.compute.manager [req-12601e57-74d4-4fae-8a55-43b8a97d282e req-9416f04b-e199-41a5-a226-4de73b20d1ed service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state active and task_state rescuing.
Apr 11 20:53:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance destroyed successfully.
Apr 11 20:53:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Attempting rescue
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71654) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:53:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Creating image(s)
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue" returned: 0 in 0.054s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'migration_context' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Start _get_guest_xml network_info=[{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:ae:c8:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'resources' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'numa_topology' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:29 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:29 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1225023406',display_name='tempest-ServerRescueNegativeTestJSON-server-1225023406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1225023406',id=29,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4x6uP246VWRPkKSeoaF0rKad7haM9o+g0vO55lyTBMphQrGzfiAPwPyJOIeXbxZxLBgRKOqIaGp/M0eiVeOUEpldUvWk5YlfA9kM4Hp1+g48Kwhly6qXWHqLhlF/xwtA==',key_name='tempest-keypair-440521057',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-8g0g1nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=3be648d4-6469-4c11-a51b-06c3fb4c9a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:ae:c8:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "vif_mac": "fa:16:3e:ae:c8:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'pci_devices' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:53:29 user nova-compute[71654]:   <uuid>3be648d4-6469-4c11-a51b-06c3fb4c9a6b</uuid>
Apr 11 20:53:29 user nova-compute[71654]:   <name>instance-0000001d</name>
Apr 11 20:53:29 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:53:29 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:53:29 user nova-compute[71654]:   <metadata>
Apr 11 20:53:29 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:53:29 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:53:29 user nova-compute[71654]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1225023406</nova:name>
Apr 11 20:53:29 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:53:29</nova:creationTime>
Apr 11 20:53:29 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:53:29 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:53:29 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:53:29 user nova-compute[71654]:       <nova:owner>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:user uuid="dce0b6fa6d9546c8a04b7a4a5f93e0c7">tempest-ServerRescueNegativeTestJSON-777351805-project-member</nova:user>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:project uuid="a2ad2f73c14141dd8f7aa0d6f6c747b0">tempest-ServerRescueNegativeTestJSON-777351805</nova:project>
Apr 11 20:53:29 user nova-compute[71654]:       </nova:owner>
Apr 11 20:53:29 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:53:29 user nova-compute[71654]:       <nova:ports>
Apr 11 20:53:29 user nova-compute[71654]:         <nova:port uuid="6cba1d9f-880d-4dbe-9315-db1ba21cb865">
Apr 11 20:53:29 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 20:53:29 user nova-compute[71654]:         </nova:port>
Apr 11 20:53:29 user nova-compute[71654]:       </nova:ports>
Apr 11 20:53:29 user nova-compute[71654]:     </nova:instance>
Apr 11 20:53:29 user nova-compute[71654]:   </metadata>
Apr 11 20:53:29 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:53:29 user nova-compute[71654]:     <system>
Apr 11 20:53:29 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:53:29 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:53:29 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:53:29 user nova-compute[71654]:       <entry name="serial">3be648d4-6469-4c11-a51b-06c3fb4c9a6b</entry>
Apr 11 20:53:29 user nova-compute[71654]:       <entry name="uuid">3be648d4-6469-4c11-a51b-06c3fb4c9a6b</entry>
Apr 11 20:53:29 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:53:29 user nova-compute[71654]:     </system>
Apr 11 20:53:29 user nova-compute[71654]:   </sysinfo>
Apr 11 20:53:29 user nova-compute[71654]:   <os>
Apr 11 20:53:29 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:53:29 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:53:29 user nova-compute[71654]:   </os>
Apr 11 20:53:29 user nova-compute[71654]:   <features>
Apr 11 20:53:29 user nova-compute[71654]:     <acpi/>
Apr 11 20:53:29 user nova-compute[71654]:     <apic/>
Apr 11 20:53:29 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:53:29 user nova-compute[71654]:   </features>
Apr 11 20:53:29 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:53:29 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:53:29 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:53:29 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:53:29 user nova-compute[71654]:   </clock>
Apr 11 20:53:29 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:53:29 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:53:29 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:53:29 user nova-compute[71654]:   </cpu>
Apr 11 20:53:29 user nova-compute[71654]:   <devices>
Apr 11 20:53:29 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:53:29 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:53:29 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue"/>
Apr 11 20:53:29 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:53:29 user nova-compute[71654]:     </disk>
Apr 11 20:53:29 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:53:29 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:53:29 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk"/>
Apr 11 20:53:29 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:53:29 user nova-compute[71654]:     </disk>
Apr 11 20:53:29 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:53:29 user nova-compute[71654]:       <mac address="fa:16:3e:ae:c8:b4"/>
Apr 11 20:53:29 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:29 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:53:29 user nova-compute[71654]:       <target dev="tap6cba1d9f-88"/>
Apr 11 20:53:29 user nova-compute[71654]:     </interface>
Apr 11 20:53:29 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:53:29 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/console.log" append="off"/>
Apr 11 20:53:29 user nova-compute[71654]:     </serial>
Apr 11 20:53:29 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:53:29 user nova-compute[71654]:     <video>
Apr 11 20:53:29 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:29 user nova-compute[71654]:     </video>
Apr 11 20:53:29 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:53:29 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:53:29 user nova-compute[71654]:     </rng>
Apr 11 20:53:29 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:53:29 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:53:29 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:53:29 user nova-compute[71654]:     </memballoon>
Apr 11 20:53:29 user nova-compute[71654]:   </devices>
Apr 11 20:53:29 user nova-compute[71654]: </domain>
Apr 11 20:53:29 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:53:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance destroyed successfully.
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] No VIF found with MAC fa:16:3e:ae:c8:b4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:53:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid f1d5f91c-afaa-456a-97e7-0460b1748d79 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [{"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-f1d5f91c-afaa-456a-97e7-0460b1748d79" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:30 user nova-compute[71654]: WARNING nova.compute.manager [req-30adabce-52b2-4e1b-8a83-60695656f4c4 req-82a86296-ecdd-4c75-b268-9aa16d1faee2 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state active and task_state rescuing.
Apr 11 20:53:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:32 user nova-compute[71654]: INFO nova.compute.manager [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Rescuing
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:33 user nova-compute[71654]: WARNING nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state active and task_state rescuing.
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:33 user nova-compute[71654]: WARNING nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state active and task_state rescuing.
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-changed-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Refreshing instance network info cache due to event network-changed-a5b56921-0469-48f8-bbe7-b4106babb386. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquiring lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquired lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Refreshing network info cache for port a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 3be648d4-6469-4c11-a51b-06c3fb4c9a6b due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246413.371479, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Resumed (Lifecycle Event)
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Stashing vm_state: active {{(pid=71654) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d29ac30e-14da-4b96-8a70-e87b00f25424 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246413.3738108, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:33 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Started (Lifecycle Event)
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.network.neutron [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updating instance_info_cache with network_info: [{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_requests' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:53:33 user nova-compute[71654]: INFO nova.compute.claims [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Claim successful on node user
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'pci_devices' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updated VIF entry in instance network info cache for port a5b56921-0469-48f8-bbe7-b4106babb386. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:33 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating resource usage from migration f0cceb4e-998f-4501-8dfe-7c7637e597dd
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Releasing lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-changed-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Refreshing instance network info cache due to event network-changed-87a70211-de9a-40c1-b767-97cff2871ab3. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquiring lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Acquired lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Refreshing network info cache for port 87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:34 user nova-compute[71654]: WARNING nova.compute.manager [req-a1e93652-2228-4421-af43-1239b02c36b3 req-a1828548-8916-4c35-ae65-c5a0c10580dc service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state rescuing.
Apr 11 20:53:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:53:34 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:34 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=26.24976348876953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance destroyed successfully.
Apr 11 20:53:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Attempting a stable device rescue
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.263s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:34 user nova-compute[71654]: INFO nova.compute.manager [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Migrating
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.038s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71654) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:53:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Creating image(s)
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "/opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "/opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'trusted_certs' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updated VIF entry in instance network info cache for port 87a70211-de9a-40c1-b767-97cff2871ab3. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "3eea1ee5cb86ff1c933288235d77145e522a0d9d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "3eea1ee5cb86ff1c933288235d77145e522a0d9d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff7982be-823a-427b-b17a-5941aa29c8bf req-00c94e93-7282-4283-8bff-1e5883cbf38e service nova] Releasing lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Applying migration context for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 as it has an incoming, in-progress migration f0cceb4e-998f-4501-8dfe-7c7637e597dd. Migration status is pre-migrating {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 20:53:35 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating resource usage from migration f0cceb4e-998f-4501-8dfe-7c7637e597dd
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Migration f0cceb4e-998f-4501-8dfe-7c7637e597dd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.part --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.virt.images [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] 98a81352-92ff-4819-ae8b-904e24fcc8b6 was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 20:53:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.part /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.part /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.converted" returned: 0 in 0.369s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:36 user nova-compute[71654]: WARNING nova.compute.manager [req-d694a475-e94e-4c74-8fe1-5f9ad17713f4 req-89913fce-ede4-4f3a-a0fd-747a689abc6f service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state rescuing.
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "3eea1ee5cb86ff1c933288235d77145e522a0d9d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.354s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "3eea1ee5cb86ff1c933288235d77145e522a0d9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "3eea1ee5cb86ff1c933288235d77145e522a0d9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.network.neutron [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.541s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d,backing_fmt=raw /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d,backing_fmt=raw /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue" returned: 0 in 0.061s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "3eea1ee5cb86ff1c933288235d77145e522a0d9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'migration_context' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Start _get_guest_xml network_info=[{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "vif_mac": "fa:16:3e:e9:e3:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '98a81352-92ff-4819-ae8b-904e24fcc8b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ead4cb65-5fee-46c2-8e8a-3cb846e963b0', 'attached_at': '', 'detached_at': '', 'volume_id': '41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'serial': '41840788-b0a2-4ee3-a6c0-6bd063cc2f3b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'e5d18066-15a6-44a3-99e6-802e0b0991ab', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'resources' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Starting migrate_disk_and_power_off {{(pid=71654) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'numa_topology' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:53:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'vcpu_model' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:36 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:36 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:36 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:53:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9a26b5-b92a-4dc8-b4b5-72977082db4a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = psxjPFVh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 20:53:36 user nova-compute[71654]: node.name = iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:53:36 user nova-compute[71654]: node.tpgt = -1
Apr 11 20:53:36 user nova-compute[71654]: node.startup = automatic
Apr 11 20:53:36 user nova-compute[71654]: node.leading_login = No
Apr 11 20:53:36 user nova-compute[71654]: iface.iscsi_ifacename = default
Apr 11 20:53:36 user nova-compute[71654]: iface.net_ifacename = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.ipaddress = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.prefix_len = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.hwaddress = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.transport_name = tcp
Apr 11 20:53:36 user nova-compute[71654]: iface.initiatorname = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.vlan_id = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.vlan_priority = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.vlan_state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.iface_num = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.mtu = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.port = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.bootproto = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.subnet_mask = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.gateway = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_alt_client_id = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_dns = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_learn_iqn = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_vendor_id_state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_vendor_id = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.dhcp_slp_da = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.fragmentation = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.gratuitous_arp = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.incoming_forwarding = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.tos_state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.tos = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.ttl = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.delayed_ack = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.tcp_nagle = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.tcp_wsf_state = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.tcp_wsf = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.tcp_timer_scale = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.tcp_timestamp = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.redirect = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.def_task_mgmt_timeout = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.header_digest = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.data_digest = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.immediate_data = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.initial_r2t = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.data_seq_inorder = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.data_pdu_inorder = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.erl = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.max_receive_data_len = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.first_burst_len = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.max_outstanding_r2t = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.max_burst_len = 0
Apr 11 20:53:36 user nova-compute[71654]: iface.chap_auth = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.bidi_chap = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.strict_login_compliance = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.discovery_auth = <empty>
Apr 11 20:53:36 user nova-compute[71654]: iface.discovery_logout = <empty>
Apr 11 20:53:36 user nova-compute[71654]: node.discovery_address = <empty>
Apr 11 20:53:36 user nova-compute[71654]: node.discovery_port = 0
Apr 11 20:53:36 user nova-compute[71654]: node.discovery_type = static
Apr 11 20:53:36 user nova-compute[71654]: node.session.initial_cmdsn = 0
Apr 11 20:53:36 user nova-compute[71654]: node.session.initial_login_retry_max = 8
Apr 11 20:53:36 user nova-compute[71654]: node.session.xmit_thread_priority = -20
Apr 11 20:53:36 user nova-compute[71654]: node.session.cmds_max = 128
Apr 11 20:53:36 user nova-compute[71654]: node.session.queue_depth = 32
Apr 11 20:53:36 user nova-compute[71654]: node.session.nr_sessions = 1
Apr 11 20:53:36 user nova-compute[71654]: node.session.auth.authmethod = CHAP
Apr 11 20:53:36 user nova-compute[71654]: node.session.auth.username = psxjPFVh
Apr 11 20:53:36 user nova-compute[71654]: node.session.auth.password = ***
Apr 11 20:53:36 user nova-compute[71654]: node.session.auth.username_in = <empty>
Apr 11 20:53:36 user nova-compute[71654]: node.session.auth.password_in = <empty>
Apr 11 20:53:36 user nova-compute[71654]: node.session.auth.chap_algs = MD5
Apr 11 20:53:36 user nova-compute[71654]: node.session.timeo.replacement_timeout = 120
Apr 11 20:53:36 user nova-compute[71654]: node.session.err_timeo.abort_timeout = 15
Apr 11 20:53:36 user nova-compute[71654]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 20:53:36 user nova-compute[71654]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 20:53:36 user nova-compute[71654]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.FastAbort = Yes
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.InitialR2T = No
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.ImmediateData = Yes
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.MaxConnections = 1
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 20:53:36 user nova-compute[71654]: node.session.iscsi.ERL = 0
Apr 11 20:53:36 user nova-compute[71654]: node.session.scan = manual
Apr 11 20:53:36 user nova-compute[71654]: node.session.reopen_max = 0
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].address = 172.16.0.220
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].port = 3260
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].startup = manual
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].tcp.window_size = 524288
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].tcp.type_of_service = 0
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].timeo.logout_timeout = 15
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].timeo.login_timeout = 15
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].timeo.auth_timeout = 45
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].iscsi.DataDigest = None
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].iscsi.IFMarker = No
Apr 11 20:53:36 user nova-compute[71654]: node.conn[0].iscsi.OFMarker = No
Apr 11 20:53:36 user nova-compute[71654]: # END RECORD
Apr 11 20:53:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36be66-a03b-47dd-bda7-ba70ecab2a2a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bb8f91-66d3-4dcb-b122-3a996a1467b5]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psxjPFVh {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psxjPFVh" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ceb3de-6672-48b9-9c9b-78d10ee2fae2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psxjPFVh'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe6962-eddb-41ca-848d-31e98576eeb2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edecb94-6db6-44a1-bbc4-fae2dfd44b61]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:36 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:36 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:36 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:36 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:36 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:36 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:36 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] HCTL ('33', '0', '0', 0) found on session 35 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[089af757-e2eb-4475-818e-690bd1d9f19b]: (4, ('0 0 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Searching for a device in session 35 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '23463613062626630', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463613062626630', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-unplugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-unplugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:36 user nova-compute[71654]: WARNING nova.compute.manager [req-46f302d9-c216-46af-9d7a-27ece1dd650a req-b39f3c61-b008-4006-9696-b3ea5dc2d04f service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-unplugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state active and task_state resize_migrating.
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494251155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494251155',id=31,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:51:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-d1065dnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:51:58Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=ead4cb65-5fee-46c2-8e8a-3cb846e963b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "vif_mac": "fa:16:3e:e9:e3:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "vif_mac": "fa:16:3e:e9:e3:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'pci_devices' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:53:36 user nova-compute[71654]:   <uuid>ead4cb65-5fee-46c2-8e8a-3cb846e963b0</uuid>
Apr 11 20:53:36 user nova-compute[71654]:   <name>instance-0000001f</name>
Apr 11 20:53:36 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:53:36 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:53:36 user nova-compute[71654]:   <metadata>
Apr 11 20:53:36 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:53:36 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:53:36 user nova-compute[71654]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-494251155</nova:name>
Apr 11 20:53:36 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:53:36</nova:creationTime>
Apr 11 20:53:36 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:53:36 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:53:36 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:53:36 user nova-compute[71654]:       <nova:owner>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:user uuid="1d5cb62cc3844248be2e4456d970ccdf">tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member</nova:user>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:project uuid="85bf8fe34838426ea05060463458e5e0">tempest-ServerBootFromVolumeStableRescueTest-243239500</nova:project>
Apr 11 20:53:36 user nova-compute[71654]:       </nova:owner>
Apr 11 20:53:36 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 20:53:36 user nova-compute[71654]:       <nova:ports>
Apr 11 20:53:36 user nova-compute[71654]:         <nova:port uuid="bc598d8b-b02e-429d-895b-c553ab0a415a">
Apr 11 20:53:36 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 20:53:36 user nova-compute[71654]:         </nova:port>
Apr 11 20:53:36 user nova-compute[71654]:       </nova:ports>
Apr 11 20:53:36 user nova-compute[71654]:     </nova:instance>
Apr 11 20:53:36 user nova-compute[71654]:   </metadata>
Apr 11 20:53:36 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:53:36 user nova-compute[71654]:     <system>
Apr 11 20:53:36 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:53:36 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:53:36 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:53:36 user nova-compute[71654]:       <entry name="serial">ead4cb65-5fee-46c2-8e8a-3cb846e963b0</entry>
Apr 11 20:53:36 user nova-compute[71654]:       <entry name="uuid">ead4cb65-5fee-46c2-8e8a-3cb846e963b0</entry>
Apr 11 20:53:36 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:53:36 user nova-compute[71654]:     </system>
Apr 11 20:53:36 user nova-compute[71654]:   </sysinfo>
Apr 11 20:53:36 user nova-compute[71654]:   <os>
Apr 11 20:53:36 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:53:36 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:53:36 user nova-compute[71654]:   </os>
Apr 11 20:53:36 user nova-compute[71654]:   <features>
Apr 11 20:53:36 user nova-compute[71654]:     <acpi/>
Apr 11 20:53:36 user nova-compute[71654]:     <apic/>
Apr 11 20:53:36 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:53:36 user nova-compute[71654]:   </features>
Apr 11 20:53:36 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:53:36 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:53:36 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:53:36 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:53:36 user nova-compute[71654]:   </clock>
Apr 11 20:53:36 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:53:36 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:53:36 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:53:36 user nova-compute[71654]:   </cpu>
Apr 11 20:53:36 user nova-compute[71654]:   <devices>
Apr 11 20:53:36 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:53:36 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:53:36 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:53:36 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:53:36 user nova-compute[71654]:       <serial>41840788-b0a2-4ee3-a6c0-6bd063cc2f3b</serial>
Apr 11 20:53:36 user nova-compute[71654]:     </disk>
Apr 11 20:53:36 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 20:53:36 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 20:53:36 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue"/>
Apr 11 20:53:36 user nova-compute[71654]:       <target dev="vdb" bus="virtio"/>
Apr 11 20:53:36 user nova-compute[71654]:       <boot order="1"/>
Apr 11 20:53:36 user nova-compute[71654]:     </disk>
Apr 11 20:53:36 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:53:36 user nova-compute[71654]:       <mac address="fa:16:3e:e9:e3:aa"/>
Apr 11 20:53:36 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:36 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:53:36 user nova-compute[71654]:       <target dev="tapbc598d8b-b0"/>
Apr 11 20:53:36 user nova-compute[71654]:     </interface>
Apr 11 20:53:36 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:53:36 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/console.log" append="off"/>
Apr 11 20:53:36 user nova-compute[71654]:     </serial>
Apr 11 20:53:36 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:53:36 user nova-compute[71654]:     <video>
Apr 11 20:53:36 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:36 user nova-compute[71654]:     </video>
Apr 11 20:53:36 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:53:36 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:53:36 user nova-compute[71654]:     </rng>
Apr 11 20:53:36 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:53:36 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:53:36 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:53:36 user nova-compute[71654]:     </memballoon>
Apr 11 20:53:36 user nova-compute[71654]:   </devices>
Apr 11 20:53:36 user nova-compute[71654]: </domain>
Apr 11 20:53:36 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:53:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance destroyed successfully.
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] No VIF found with MAC fa:16:3e:e9:e3:aa, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:37 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance destroyed successfully.
Apr 11 20:53:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1177514325',display_name='tempest-ServerActionsTestJSON-server-1177514325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1177514325',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-ej100p75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=49dc4f46-eb33-4fc8-ba2a-59140b9a64c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87a70211-de, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:37 user nova-compute[71654]: INFO os_vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de')
Apr 11 20:53:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:37 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbdeb6-a485-4c98-ad62-48dfb036c768]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:53:37 user nova-compute[71654]: No targets found.
Apr 11 20:53:37 user nova-compute[71654]: iSNS:
Apr 11 20:53:37 user nova-compute[71654]: No targets found.
Apr 11 20:53:37 user nova-compute[71654]: STATIC:
Apr 11 20:53:37 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230
Apr 11 20:53:37 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:53:37 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:53:37 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:53:37 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:53:37 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:53:37 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:53:37 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:53:37 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:53:37 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:53:37 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:53:37 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:53:37 user nova-compute[71654]: FIRMWARE:
Apr 11 20:53:37 user nova-compute[71654]: No targets found.
Apr 11 20:53:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:53:37 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:53:37 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68907cc-f931-47c3-9022-13f0546517f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52721d4-b957-4826-b5ec-69869986d2fb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:37 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:37 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:37 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:37 user nova-compute[71654]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:37 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:37 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:37 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb383583a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:53:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed709cb-8928-4a61-8cae-993a6ddad059]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27dd96d-7571-47fd-9d28-32df578917cb]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de2865-4611-44ae-964f-289071f7dafd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e69ee08-c458-4012-946b-6e8abddb62d5]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b483dfb-5cea-46ff-886e-9440541a4c39]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b697fc4f-023d-4505-8ff9-52b3af1b3567]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]
Apr 11 20:53:38 user nova-compute[71654]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.
Apr 11 20:53:38 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d928c98-7aa1-4c27-a1f6-3cc7bf3cc1b6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (349ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:38 user nova-compute[71654]: WARNING nova.compute.manager [req-6604f4ea-dac2-4764-8f48-4a65eba3acbe req-6b294470-f4ab-4970-9270-81d90b60a948 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state rescuing.
Apr 11 20:53:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:38 user nova-compute[71654]: DEBUG nova.compute.manager [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:38 user nova-compute[71654]: WARNING nova.compute.manager [req-9110d8b4-2e6d-474e-a9e4-dd060512be9e req-acb7a4ae-4e53-4932-bb59-190286fe28e9 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state active and task_state resize_migrating.
Apr 11 20:53:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Port 87a70211-de9a-40c1-b767-97cff2871ab3 binding to destination host user is already ACTIVE {{(pid=71654) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG os_brick.utils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[919c71ac-afa1-4d6c-8cb2-3d800d6f45cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2bb254-329b-4e2a-8477-685cc4abd281]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60d933-1f2a-462c-b2cb-3709864ed0e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d2910a-aa00-498e-b500-d95c73f2326a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:53:40 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045b210-e0a7-47f3-ae23-a52a1ef764b9]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG os_brick.utils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for ead4cb65-5fee-46c2-8e8a-3cb846e963b0 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246420.7444618, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Resumed (Lifecycle Event)
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-cb214480-0889-436d-b610-94884bcea03a tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246420.7463038, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:40 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Started (Lifecycle Event)
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:40 user nova-compute[71654]: WARNING nova.compute.manager [req-00daea04-44cd-4fc1-b10f-466e8c71d66f req-eae51828-4545-4702-a4b4-e8f58fe0012c service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state rescuing.
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:41 user nova-compute[71654]: INFO nova.compute.manager [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Unshelving
Apr 11 20:53:41 user nova-compute[71654]: INFO nova.virt.block_device [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Booting with volume 5ad85d33-3ca5-44f2-86af-fa4d8044b37b at /dev/vda
Apr 11 20:53:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ade8a-61b3-4dc3-a680-edbcc5e2db35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ef9368-2181-4e39-a4f1-df9a625362ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[70822f19-f480-4c5c-a9b5-32a3b48a99b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3890c999-2c61-4534-80a4-4d55b7775078]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:53:41 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:53:41 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb0e31-9374-4095-a8b6-5c152813df71]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG os_brick.utils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:41 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating existing volume attachment record: 0e7bdfc1-e08b-4f65-a129-2b8b5058ce5c {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:53:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Starting finish_migration {{(pid=71654) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance directory exists: not creating {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 20:53:47 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Creating image(s)
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Ensure instance console log exists: /opt/stack/data/nova/instances/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Start _get_guest_xml network_info=[{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6', 'attached_at': '2023-04-11T20:53:47.000000', 'detached_at': '', 'volume_id': '2e9baedf-a70c-41a1-8578-21a40984963e', 'serial': '2e9baedf-a70c-41a1-8578-21a40984963e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'f3e7de2f-61fb-4928-88b9-9c8b3dcf94c8', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:53:47 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:47 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.objects.instance [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:47 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:47 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:47 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d28c93-ea92-456f-96ee-f0c975f220be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:53:47 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[033e6994-ed7e-464f-8890-392c4e2d94ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e] added
Apr 11 20:53:47 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[db846eb2-bc5e-4ca8-9e57-1b497637089d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1cf93-bbf6-4a21-83ca-d71b89f382e7]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOgjLMib {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOgjLMib" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3016a90-e44c-44a5-a534-73a5f15a4f2a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eOgjLMib'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0144eed9-0bef-4aca-9036-5656f89abfbd]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[becd23d1-06a1-459c-bb55-8d84adf85860]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:47 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:47 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:47 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:47 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:47 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:47 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbae327-8031-4734-a90d-1e5875f8d87d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]
Apr 11 20:53:47 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.
Apr 11 20:53:47 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f35fa1-356f-4d8d-999d-d3d64e8bdb66]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:47 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b837fc0-e189-4b47-ab76-0dfbff7a5e23]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:48 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:48 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:48 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:48 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:48 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:48 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:48 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4378d6-6861-4d62-8160-bfa3f1e9ac61]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'pci_requests' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'numa_topology' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:48 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:53:48 user nova-compute[71654]: INFO nova.compute.claims [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Claim successful on node user
Apr 11 20:53:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23564316562336134', 'path': '/dev/sdd'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564316562336134', 'path': '/dev/sdd'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1177514325',display_name='tempest-ServerActionsTestJSON-server-1177514325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1177514325',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-ej100p75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=49dc4f46-eb33-4fc8-ba2a-59140b9a64c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:53:49 user nova-compute[71654]:   <uuid>49dc4f46-eb33-4fc8-ba2a-59140b9a64c6</uuid>
Apr 11 20:53:49 user nova-compute[71654]:   <name>instance-0000001e</name>
Apr 11 20:53:49 user nova-compute[71654]:   <memory>196608</memory>
Apr 11 20:53:49 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:53:49 user nova-compute[71654]:   <metadata>
Apr 11 20:53:49 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:53:49 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:53:49 user nova-compute[71654]:       <nova:name>tempest-ServerActionsTestJSON-server-1177514325</nova:name>
Apr 11 20:53:49 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:53:47</nova:creationTime>
Apr 11 20:53:49 user nova-compute[71654]:       <nova:flavor name="m1.micro">
Apr 11 20:53:49 user nova-compute[71654]:         <nova:memory>192</nova:memory>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:53:49 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:53:49 user nova-compute[71654]:       <nova:owner>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:user uuid="7736d32586e949e4839f826f18994a0f">tempest-ServerActionsTestJSON-633772522-project-member</nova:user>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:project uuid="9d0c94dce35b4883940b8399d6d0ba7e">tempest-ServerActionsTestJSON-633772522</nova:project>
Apr 11 20:53:49 user nova-compute[71654]:       </nova:owner>
Apr 11 20:53:49 user nova-compute[71654]:       <nova:ports>
Apr 11 20:53:49 user nova-compute[71654]:         <nova:port uuid="87a70211-de9a-40c1-b767-97cff2871ab3">
Apr 11 20:53:49 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 20:53:49 user nova-compute[71654]:         </nova:port>
Apr 11 20:53:49 user nova-compute[71654]:       </nova:ports>
Apr 11 20:53:49 user nova-compute[71654]:     </nova:instance>
Apr 11 20:53:49 user nova-compute[71654]:   </metadata>
Apr 11 20:53:49 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:53:49 user nova-compute[71654]:     <system>
Apr 11 20:53:49 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:53:49 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:53:49 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:53:49 user nova-compute[71654]:       <entry name="serial">49dc4f46-eb33-4fc8-ba2a-59140b9a64c6</entry>
Apr 11 20:53:49 user nova-compute[71654]:       <entry name="uuid">49dc4f46-eb33-4fc8-ba2a-59140b9a64c6</entry>
Apr 11 20:53:49 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:53:49 user nova-compute[71654]:     </system>
Apr 11 20:53:49 user nova-compute[71654]:   </sysinfo>
Apr 11 20:53:49 user nova-compute[71654]:   <os>
Apr 11 20:53:49 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:53:49 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:53:49 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:53:49 user nova-compute[71654]:   </os>
Apr 11 20:53:49 user nova-compute[71654]:   <features>
Apr 11 20:53:49 user nova-compute[71654]:     <acpi/>
Apr 11 20:53:49 user nova-compute[71654]:     <apic/>
Apr 11 20:53:49 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:53:49 user nova-compute[71654]:   </features>
Apr 11 20:53:49 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:53:49 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:53:49 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:53:49 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:53:49 user nova-compute[71654]:   </clock>
Apr 11 20:53:49 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:53:49 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:53:49 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:53:49 user nova-compute[71654]:   </cpu>
Apr 11 20:53:49 user nova-compute[71654]:   <devices>
Apr 11 20:53:49 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:53:49 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:53:49 user nova-compute[71654]:       <source dev="/dev/sdd"/>
Apr 11 20:53:49 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:53:49 user nova-compute[71654]:       <serial>2e9baedf-a70c-41a1-8578-21a40984963e</serial>
Apr 11 20:53:49 user nova-compute[71654]:     </disk>
Apr 11 20:53:49 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:53:49 user nova-compute[71654]:       <mac address="fa:16:3e:f1:4a:c8"/>
Apr 11 20:53:49 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:49 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:53:49 user nova-compute[71654]:       <target dev="tap87a70211-de"/>
Apr 11 20:53:49 user nova-compute[71654]:     </interface>
Apr 11 20:53:49 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:53:49 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6/console.log" append="off"/>
Apr 11 20:53:49 user nova-compute[71654]:     </serial>
Apr 11 20:53:49 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:53:49 user nova-compute[71654]:     <video>
Apr 11 20:53:49 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:49 user nova-compute[71654]:     </video>
Apr 11 20:53:49 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:53:49 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:53:49 user nova-compute[71654]:     </rng>
Apr 11 20:53:49 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:53:49 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:53:49 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:53:49 user nova-compute[71654]:     </memballoon>
Apr 11 20:53:49 user nova-compute[71654]:   </devices>
Apr 11 20:53:49 user nova-compute[71654]: </domain>
Apr 11 20:53:49 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1177514325',display_name='tempest-ServerActionsTestJSON-server-1177514325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1177514325',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:51:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-ej100p75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=49dc4f46-eb33-4fc8-ba2a-59140b9a64c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021591232-network", "vif_mac": "fa:16:3e:f1:4a:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG os_vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87a70211-de, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87a70211-de, col_values=(('external_ids', {'iface-id': '87a70211-de9a-40c1-b767-97cff2871ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:4a:c8', 'vm-uuid': '49dc4f46-eb33-4fc8-ba2a-59140b9a64c6'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:49 user nova-compute[71654]: INFO os_vif [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de')
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] No VIF found with MAC fa:16:3e:f1:4a:c8, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:53:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:49 user nova-compute[71654]: INFO nova.network.neutron [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating port 4eaf9038-98d7-4312-8905-dba89af13ae4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing instance network info cache due to event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:50 user nova-compute[71654]: WARNING nova.compute.manager [req-6bf35f25-976e-4876-9a56-db8527e078f5 req-e4ee388e-4368-4a8c-a856-568364609638 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state active and task_state resize_finish.
Apr 11 20:53:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.network.neutron [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:53:50 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Creating image(s)
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Ensure instance console log exists: /opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Start _get_guest_xml network_info=[{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93e7b2c8-565c-49ec-8dc2-c8a1489eab6b', 'attached_at': '', 'detached_at': '', 'volume_id': '5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'serial': '5ad85d33-3ca5-44f2-86af-fa4d8044b37b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '0e7bdfc1-e08b-4f65-a129-2b8b5058ce5c', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:53:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:53:50 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:50 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:53:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:53:50 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6b9b57-b0b6-4a09-8722-332cccf40b28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:53:50 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd2590-a546-4f7a-ac1e-6c8dd1d914ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b] added
Apr 11 20:53:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd87ca-1bab-4a47-a994-bf8ddf2d8961]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47052a6-0840-4d27-9a03-e62d665ed190]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edIDJEKz {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edIDJEKz" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[589bba9e-30ad-498e-b975-a29d12fef436]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edIDJEKz'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46b8ea-adab-4c9e-81ff-b628bf22ea3c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b8d1d-b5f5-4b61-bab0-3bd2dc8ad898]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4884b9-9353-4696-b353-222fcbad3a5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]
Apr 11 20:53:51 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.
Apr 11 20:53:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b33a1-6b1c-49ea-8c2a-ffe716803303]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7000d8-60d6-4637-8857-7387b7f62968]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:53:51 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:53:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[76607f19-d3a7-4979-96c4-37378b771780]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updated VIF entry in instance network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG nova.network.neutron [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:53:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2a5c95ee-0ba2-478c-8e4a-3600ab6b5b91 req-239000fb-76aa-42e4-8cfd-3a1abf12c35d service nova] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23338663236353934', 'path': '/dev/sdf'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338663236353934', 'path': '/dev/sdf'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-629010364',display_name='tempest-TestShelveInstance-server-629010364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-629010364',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-176056509',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b26639cfda0489797dd5c7fbfc75927',ramdisk_id='',reservation_id='r-xkiua7y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1168874819',owner_user_name='tempest-TestShelveInstance-1168874819-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:42Z,user_data=None,user_id='f2ee47ef8e2248dda212a623eab9915b',uuid=93e7b2c8-565c-49ec-8dc2-c8a1489eab6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converting VIF {"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'pci_devices' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:53:52 user nova-compute[71654]:   <uuid>93e7b2c8-565c-49ec-8dc2-c8a1489eab6b</uuid>
Apr 11 20:53:52 user nova-compute[71654]:   <name>instance-0000001b</name>
Apr 11 20:53:52 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:53:52 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:53:52 user nova-compute[71654]:   <metadata>
Apr 11 20:53:52 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:53:52 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:53:52 user nova-compute[71654]:       <nova:name>tempest-TestShelveInstance-server-629010364</nova:name>
Apr 11 20:53:52 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:53:50</nova:creationTime>
Apr 11 20:53:52 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:53:52 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:53:52 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:53:52 user nova-compute[71654]:       <nova:owner>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:user uuid="f2ee47ef8e2248dda212a623eab9915b">tempest-TestShelveInstance-1168874819-project-member</nova:user>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:project uuid="2b26639cfda0489797dd5c7fbfc75927">tempest-TestShelveInstance-1168874819</nova:project>
Apr 11 20:53:52 user nova-compute[71654]:       </nova:owner>
Apr 11 20:53:52 user nova-compute[71654]:       <nova:ports>
Apr 11 20:53:52 user nova-compute[71654]:         <nova:port uuid="4eaf9038-98d7-4312-8905-dba89af13ae4">
Apr 11 20:53:52 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:53:52 user nova-compute[71654]:         </nova:port>
Apr 11 20:53:52 user nova-compute[71654]:       </nova:ports>
Apr 11 20:53:52 user nova-compute[71654]:     </nova:instance>
Apr 11 20:53:52 user nova-compute[71654]:   </metadata>
Apr 11 20:53:52 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:53:52 user nova-compute[71654]:     <system>
Apr 11 20:53:52 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:53:52 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:53:52 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:53:52 user nova-compute[71654]:       <entry name="serial">93e7b2c8-565c-49ec-8dc2-c8a1489eab6b</entry>
Apr 11 20:53:52 user nova-compute[71654]:       <entry name="uuid">93e7b2c8-565c-49ec-8dc2-c8a1489eab6b</entry>
Apr 11 20:53:52 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:53:52 user nova-compute[71654]:     </system>
Apr 11 20:53:52 user nova-compute[71654]:   </sysinfo>
Apr 11 20:53:52 user nova-compute[71654]:   <os>
Apr 11 20:53:52 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:53:52 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:53:52 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:53:52 user nova-compute[71654]:   </os>
Apr 11 20:53:52 user nova-compute[71654]:   <features>
Apr 11 20:53:52 user nova-compute[71654]:     <acpi/>
Apr 11 20:53:52 user nova-compute[71654]:     <apic/>
Apr 11 20:53:52 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:53:52 user nova-compute[71654]:   </features>
Apr 11 20:53:52 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:53:52 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:53:52 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:53:52 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:53:52 user nova-compute[71654]:   </clock>
Apr 11 20:53:52 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:53:52 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:53:52 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:53:52 user nova-compute[71654]:   </cpu>
Apr 11 20:53:52 user nova-compute[71654]:   <devices>
Apr 11 20:53:52 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:53:52 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:53:52 user nova-compute[71654]:       <source dev="/dev/sdf"/>
Apr 11 20:53:52 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:53:52 user nova-compute[71654]:       <serial>5ad85d33-3ca5-44f2-86af-fa4d8044b37b</serial>
Apr 11 20:53:52 user nova-compute[71654]:     </disk>
Apr 11 20:53:52 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:53:52 user nova-compute[71654]:       <mac address="fa:16:3e:f4:ee:64"/>
Apr 11 20:53:52 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:52 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:53:52 user nova-compute[71654]:       <target dev="tap4eaf9038-98"/>
Apr 11 20:53:52 user nova-compute[71654]:     </interface>
Apr 11 20:53:52 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:53:52 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b/console.log" append="off"/>
Apr 11 20:53:52 user nova-compute[71654]:     </serial>
Apr 11 20:53:52 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:53:52 user nova-compute[71654]:     <video>
Apr 11 20:53:52 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:53:52 user nova-compute[71654]:     </video>
Apr 11 20:53:52 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:53:52 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:53:52 user nova-compute[71654]:     </rng>
Apr 11 20:53:52 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:53:52 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:53:52 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:53:52 user nova-compute[71654]:     </memballoon>
Apr 11 20:53:52 user nova-compute[71654]:   </devices>
Apr 11 20:53:52 user nova-compute[71654]: </domain>
Apr 11 20:53:52 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-629010364',display_name='tempest-TestShelveInstance-server-629010364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-629010364',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-176056509',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b26639cfda0489797dd5c7fbfc75927',ramdisk_id='',reservation_id='r-xkiua7y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1168874819',owner_user_name='tempest-TestShelveInstance-1168874819-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:42Z,user_data=None,user_id='f2ee47ef8e2248dda212a623eab9915b',uuid=93e7b2c8-565c-49ec-8dc2-c8a1489eab6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converting VIF {"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG os_vif [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eaf9038-98, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4eaf9038-98, col_values=(('external_ids', {'iface-id': '4eaf9038-98d7-4312-8905-dba89af13ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ee:64', 'vm-uuid': '93e7b2c8-565c-49ec-8dc2-c8a1489eab6b'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:52 user nova-compute[71654]: INFO os_vif [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98')
Apr 11 20:53:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] No VIF found with MAC fa:16:3e:f4:ee:64, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246432.6627336, 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:52 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] VM Resumed (Lifecycle Event)
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:53:52 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance running successfully.
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Failed to set time: agent not configured {{(pid=71654) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-761c7143-8aa1-4466-88b9-1e8873e6c542 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] finish_migration finished successfully. {{(pid=71654) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:52 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246432.663868, 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:52 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] VM Started (Lifecycle Event)
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:52 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 20:53:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:53 user nova-compute[71654]: DEBUG nova.compute.manager [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:53 user nova-compute[71654]: WARNING nova.compute.manager [req-ec607d9c-3ab4-497f-8d0c-c933f92430ca req-47845f85-e2ae-47b6-9bd7-1af286611b28 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state resized and task_state None.
Apr 11 20:53:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG nova.compute.manager [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:54 user nova-compute[71654]: WARNING nova.compute.manager [req-7aea4bad-8829-46b6-b8dd-f02f4e98901b req-520d440b-9a8f-47e8-ab49-78379ebdc44f service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 20:53:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246436.09927, 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] VM Resumed (Lifecycle Event)
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance spawned successfully.
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246436.1107776, 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:53:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] VM Started (Lifecycle Event)
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:53:56 user nova-compute[71654]: WARNING nova.compute.manager [req-4061c4c8-d7b3-4b95-bf66-de26a8c5d7db req-89318be2-fdef-4ce0-8360-1730467cd1e0 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 20:53:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:53:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e5d08e26-425a-441a-b6fc-984683e4eb1c tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.553s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:53:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:53:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:22 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:54:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [{"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-05f0405b-e73d-4c84-8208-21194ab434d2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:54:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=26.14773178100586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Applying migration context for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 as it has an incoming, in-progress migration f0cceb4e-998f-4501-8dfe-7c7637e597dd. Migration status is finished {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 20:54:36 user nova-compute[71654]: INFO nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating resource usage from migration f0cceb4e-998f-4501-8dfe-7c7637e597dd
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Migration f0cceb4e-998f-4501-8dfe-7c7637e597dd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:54:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:54:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:54:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:54:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:54:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:54:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-changed-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:54:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Refreshing instance network info cache due to event network-changed-0c429f6b-6a13-4752-ab77-35aad97b9a10. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:54:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Acquiring lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:54:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Acquired lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:54:46 user nova-compute[71654]: DEBUG nova.network.neutron [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Refreshing network info cache for port 0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:54:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:47 user nova-compute[71654]: DEBUG nova.network.neutron [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updated VIF entry in instance network info cache for port 0c429f6b-6a13-4752-ab77-35aad97b9a10. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:54:47 user nova-compute[71654]: DEBUG nova.network.neutron [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updating instance_info_cache with network_info: [{"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:54:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-63f6703c-d6d2-42ca-aeef-a5ca9fdb3107 req-444b5ae7-3177-4385-b61b-f509d417701a service nova] Releasing lock "refresh_cache-a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:54:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:54:48 user nova-compute[71654]: INFO nova.compute.manager [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Attaching volume 306a3747-1a8f-43b5-a496-9cb6ff82eae0 to /dev/vdb
Apr 11 20:54:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c16b13f-3f86-4147-8332-c6d2b64b8f56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a36468-4ef5-4ce7-8c3d-018d5ba756fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a2188-4972-4bf0-b0d4-4d8ebd1d4cd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e944aa9e-4cdd-4298-98ae-44a2810c8a0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:54:48 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:54:48 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531f620-92ae-4ee5-9696-2ae16dbe1468]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG os_brick.utils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:54:48 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updating existing volume attachment record: a006214f-fdf8-4fca-9e5b-f897b66f3e41 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwoOQIyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:54:52 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:54:52 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:54:52 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[44555396-fdae-48a3-b468-eb6d8c5f313f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:54:52 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8811fe54-3531-40ac-82d2-3f7fb75cdadd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0] added
Apr 11 20:54:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[22528c4e-ec30-4e61-b80c-ae0b0194c35f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d73e1e8-6d60-4f0b-a527-349da9d29399]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwoOQIyk {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwoOQIyk" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8fe657-7cfb-42a1-b5a5-51d14b5216e8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FwoOQIyk'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b1388-d447-4b4d-b7c1-7afb4ae4e7b1]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f12573-bfb7-4958-a556-b9a441649ae1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:54:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:54:52 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:54:52 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:54:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d119f-f9f6-4a3f-969f-e2d656286c74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260]
Apr 11 20:54:53 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260] successful.
Apr 11 20:54:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f2502-7fe9-487d-bc12-f4d0a800d93e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59aed89-780e-4347-b55a-cfa98c57b18e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 (non-flash)
Apr 11 20:54:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:54:53 user nova-compute[71654]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 (non-flash)
Apr 11 20:54:53 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f500592-324f-4095-ad6d-96b33219401a]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:54:53 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwoOQIyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26165636332323637', 'path': '/dev/sdg'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165636332323637', 'path': '/dev/sdg'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG nova.objects.instance [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 20:54:54 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:54:54 user nova-compute[71654]:   <source dev="/dev/sdg"/>
Apr 11 20:54:54 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:54:54 user nova-compute[71654]:   <serial>306a3747-1a8f-43b5-a496-9cb6ff82eae0</serial>
Apr 11 20:54:54 user nova-compute[71654]: </disk>
Apr 11 20:54:54 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] No VIF found with MAC fa:16:3e:9e:6d:2d, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:54:54 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a5cab9d-ab2c-4c9e-aac6-00f01c326bac tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.174s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:54:55 user nova-compute[71654]: INFO nova.compute.manager [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Detaching volume 306a3747-1a8f-43b5-a496-9cb6ff82eae0
Apr 11 20:54:55 user nova-compute[71654]: INFO nova.virt.block_device [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Attempting to driver detach volume 306a3747-1a8f-43b5-a496-9cb6ff82eae0 from mountpoint /dev/vdb
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Attempting to detach device vdb from instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:54:55 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:54:55 user nova-compute[71654]:   <source dev="/dev/sdg"/>
Apr 11 20:54:55 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:54:55 user nova-compute[71654]:   <serial>306a3747-1a8f-43b5-a496-9cb6ff82eae0</serial>
Apr 11 20:54:55 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:54:55 user nova-compute[71654]: </disk>
Apr 11 20:54:55 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:54:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully detached device vdb from instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 from the persistent domain config.
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:54:55 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:54:55 user nova-compute[71654]:   <source dev="/dev/sdg"/>
Apr 11 20:54:55 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:54:55 user nova-compute[71654]:   <serial>306a3747-1a8f-43b5-a496-9cb6ff82eae0</serial>
Apr 11 20:54:55 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:54:55 user nova-compute[71654]: </disk>
Apr 11 20:54:55 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246495.758742, a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:54:55 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully detached device vdb from instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 from the live domain config.
Apr 11 20:54:55 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwoOQIyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:54:55 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e307812-f5d6-4c90-9462-de15573c6413]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:54:55 user nova-compute[71654]: No targets found.
Apr 11 20:54:55 user nova-compute[71654]: iSNS:
Apr 11 20:54:55 user nova-compute[71654]: No targets found.
Apr 11 20:54:55 user nova-compute[71654]: STATIC:
Apr 11 20:54:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0
Apr 11 20:54:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:54:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:54:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230
Apr 11 20:54:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:54:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:54:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b
Apr 11 20:54:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:54:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:54:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:54:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:54:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:54:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:54:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:54:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:54:55 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:54:55 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:54:55 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:54:55 user nova-compute[71654]: FIRMWARE:
Apr 11 20:54:55 user nova-compute[71654]: No targets found.
Apr 11 20:54:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:54:55 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:54:55 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c823e08-e9a0-45d7-91c5-b14e9aff48af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc7e9e-0000-4f60-a70e-e2dfd712fab5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 (non-flash)
Apr 11 20:54:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:54:55 user nova-compute[71654]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 (non-flash)
Apr 11 20:54:55 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb381ec550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0'): ({'sdg'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Removing single pathed devices sdg {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f9ca4f-a0d1-4edb-bff9-cc8f1ee8faf9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603ed8e-45a4-43f8-ab26-a0a54258b581]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Flushing IO for device /dev/sdg {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6461f8c-176b-4f15-8412-c579cd161abe]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4415ebd9-a1f0-4684-88fc-d73e5e8bc849]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] SCSI volumes sdg have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6b347b-80d0-4def-83ba-25461949fcff]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:55 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d51e060-da7b-4369-b692-dff37be723f9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260]
Apr 11 20:54:56 user nova-compute[71654]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0, portal: 172.16.0.220,3260] successful.
Apr 11 20:54:56 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:306a3747-1a8f-43b5-a496-9cb6ff82eae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04620a2-c0fb-40cf-8fb9-afed33bd7340]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] <== disconnect_volume: return (311ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG nova.objects.instance [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'flavor' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:54:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-11739fc0-0f5d-4716-acdb-53725cd5976c tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:54:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:54:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:55:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:55:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:55:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:55:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:19 user nova-compute[71654]: INFO nova.compute.manager [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Unrescuing
Apr 11 20:55:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:55:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:55:19 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG nova.objects.instance [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:20 user nova-compute[71654]: WARNING nova.compute.manager [req-2edeea9c-21ff-4e32-a381-b486cfe91631 req-802f9960-7ec3-459c-bcc2-b753d692bb60 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance destroyed successfully.
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:22 user nova-compute[71654]: WARNING nova.compute.manager [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:22 user nova-compute[71654]: WARNING nova.compute.manager [req-d22d55d1-61b4-4ae5-9fe3-9b3127b2abbc req-d27a724f-79d0-43b0-85a2-dfcc0acdb9d5 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG nova.compute.manager [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Going to confirm migration 2 {{(pid=71654) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquired lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG nova.objects.instance [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'info_cache' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:55:23 user nova-compute[71654]: INFO nova.compute.manager [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Unrescuing
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquired lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG nova.network.neutron [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [{"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Releasing lock "refresh_cache-49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG nova.objects.instance [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'migration_context' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.network.neutron [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updating instance_info_cache with network_info: [{"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Releasing lock "refresh_cache-ead4cb65-5fee-46c2-8e8a-3cb846e963b0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.objects.instance [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'flavor' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:24 user nova-compute[71654]: WARNING nova.compute.manager [req-b4f4c646-d556-4773-9593-a650647b909e req-d5eeabd5-9407-44fd-b439-ef2e853d9582 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for 3be648d4-6469-4c11-a51b-06c3fb4c9a6b due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246524.488, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:55:24 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Resumed (Lifecycle Event)
Apr 11 20:55:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:24 user nova-compute[71654]: WARNING nova.compute.manager [req-26ecd1b2-d1e0-4541-96be-09b2a02c315e req-3ff6e344-36da-4f41-8356-1f1e6aacd58b service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-3f84fcf7-8c63-470b-9f0f-11489d21e513 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.563s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:55:24 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246524.4945428, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:55:24 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Started (Lifecycle Event)
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:55:24 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Deleted allocation for migration f0cceb4e-998f-4501-8dfe-7c7637e597dd
Apr 11 20:55:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-17ef277c-65ee-4a63-a6fe-dcf42218671d tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.769s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:24 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance destroyed successfully.
Apr 11 20:55:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:26 user nova-compute[71654]: WARNING nova.compute.manager [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:26 user nova-compute[71654]: WARNING nova.compute.manager [req-d08d62a2-112b-4a42-b7b7-9ddacbb90402 req-fcf4acab-d9f1-4e18-b18b-91768a9b9bf5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state rescued and task_state unrescuing.
Apr 11 20:55:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.host [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Removed pending event for ead4cb65-5fee-46c2-8e8a-3cb846e963b0 due to event {{(pid=71654) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246528.3515642, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:55:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Resumed (Lifecycle Event)
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-20b347cd-30f2-46df-8f9a-656686c4849f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:55:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246528.3528643, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:55:28 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Started (Lifecycle Event)
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:28 user nova-compute[71654]: WARNING nova.compute.manager [req-729a869e-bd67-4691-854a-a2a95e9f76ba req-0824db99-d023-4f28-b4ae-9d3eae576f09 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state None.
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:55:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing instance network info cache due to event network-changed-4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Acquiring lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Acquired lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Refreshing network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:33 user nova-compute[71654]: INFO nova.compute.manager [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Terminating instance
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-unplugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-unplugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-ff1d8496-e612-4ae1-b7a4-efaaa93c30ab req-44cc8d28-47e9-4c93-8cb2-180d77a564cd service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-unplugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updated VIF entry in instance network info cache for port 4eaf9038-98d7-4312-8905-dba89af13ae4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [{"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a741f4d9-37a5-4f50-bbda-bc0d63e3df2f req-aaea0035-eb4b-4a6d-a57b-258043a1fe48 service nova] Releasing lock "refresh_cache-93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:55:33 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Instance destroyed successfully.
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lazy-loading 'resources' on Instance uuid 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-629010364',display_name='tempest-TestShelveInstance-server-629010364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-629010364',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAWJOf6I9rkJJXNLcDZX/Kb6Vxi27X1aA5/xNyjqDDLkYDF/zBtuVuX91idOh4pF42cJIilfyIyndvzyDZ0CJJ+uJagML47ITzNKfhOoXVlQ3i4YUlRBXFD0Cd/N8jq5A==',key_name='tempest-TestShelveInstance-176056509',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:53:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b26639cfda0489797dd5c7fbfc75927',ramdisk_id='',reservation_id='r-xkiua7y0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1168874819',owner_user_name='tempest-TestShelveInstance-1168874819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:56Z,user_data=None,user_id='f2ee47ef8e2248dda212a623eab9915b',uuid=93e7b2c8-565c-49ec-8dc2-c8a1489eab6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converting VIF {"id": "4eaf9038-98d7-4312-8905-dba89af13ae4", "address": "fa:16:3e:f4:ee:64", "network": {"id": "d616994f-0b7d-4e58-b7b3-f1318b6204a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1937940272-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b26639cfda0489797dd5c7fbfc75927", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eaf9038-98", "ovs_interfaceid": "4eaf9038-98d7-4312-8905-dba89af13ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_vif [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eaf9038-98, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:55:33 user nova-compute[71654]: INFO os_vif [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ee:64,bridge_name='br-int',has_traffic_filtering=True,id=4eaf9038-98d7-4312-8905-dba89af13ae4,network=Network(d616994f-0b7d-4e58-b7b3-f1318b6204a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eaf9038-98')
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edIDJEKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:55:33 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b1af0-093e-4f27-bd94-9a3d3cec1af9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:55:33 user nova-compute[71654]: No targets found.
Apr 11 20:55:33 user nova-compute[71654]: iSNS:
Apr 11 20:55:33 user nova-compute[71654]: No targets found.
Apr 11 20:55:33 user nova-compute[71654]: STATIC:
Apr 11 20:55:33 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230
Apr 11 20:55:33 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:55:33 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:55:33 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b
Apr 11 20:55:33 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:55:33 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:55:33 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:55:33 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:55:33 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:55:33 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:55:33 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:55:33 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:55:33 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:55:33 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:55:33 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:55:33 user nova-compute[71654]: FIRMWARE:
Apr 11 20:55:33 user nova-compute[71654]: No targets found.
Apr 11 20:55:33 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:55:33 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:55:33 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c590e506-0134-4c1b-88cf-f24ce5455a43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:33 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdc527f-1df0-4221-a69a-5b38d299c7b8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:55:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:55:34 user nova-compute[71654]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b (non-flash)
Apr 11 20:55:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb40588160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b'): ({'sdf'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Removing single pathed devices sdf {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[af93c51b-eb34-4028-a228-62d3c71f61af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a050118-f0e3-475b-b8f0-d6460e04ac8f]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Flushing IO for device /dev/sdf {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9efb676-e8d1-4553-8eae-fa5f970e142b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5054abc0-78f7-4ef3-8eca-90b24644c867]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] SCSI volumes sdf have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e88ba6b', '/dev/disk/by-id/scsi-1SCST_BIO4e88ba6b-38f2659483673baa', '/dev/disk/by-id/scsi-23338663236353934') {{(pid=81862) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528b5de-be58-4f68-bbd2-57b3b5e8051b]: (4, None) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e6266-70c5-4dcf-84fb-9f211897f6e2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab4efa1-faa3-48d0-9ec3-ed0e90d226a5]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260]
Apr 11 20:55:34 user nova-compute[71654]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b, portal: 172.16.0.220,3260] successful.
Apr 11 20:55:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad85d33-3ca5-44f2-86af-fa4d8044b37b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d1dc7e-d768-4eee-9136-fc014d74d976]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] <== disconnect_volume: return (399ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:55:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Deleting instance files /opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b_del
Apr 11 20:55:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Deletion of /opt/stack/data/nova/instances/93e7b2c8-565c-49ec-8dc2-c8a1489eab6b_del complete
Apr 11 20:55:34 user nova-compute[71654]: INFO nova.compute.manager [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updating instance_info_cache with network_info: [{"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-764a059b-9ded-4d53-b960-ced4abe4323d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-deleted-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:34 user nova-compute[71654]: INFO nova.compute.manager [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Neutron deleted interface 4eaf9038-98d7-4312-8905-dba89af13ae4; detaching it from the instance and deleting it from the info cache
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.network.neutron [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:34 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Took 0.59 seconds to deallocate network for instance.
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-757eae2c-67ad-4397-9700-75566318810b req-631456f6-3fee-4222-965f-1159dff03a13 service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Detach interface failed, port_id=4eaf9038-98d7-4312-8905-dba89af13ae4, reason: Instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:55:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Acquiring lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG nova.compute.manager [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] No waiting events found dispatching network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:35 user nova-compute[71654]: WARNING nova.compute.manager [req-60b1354f-2614-47f4-8688-6ff287e6e002 req-d0419c6a-6827-4f6b-a46d-c1e088bbf9bc service nova] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Received unexpected event network-vif-plugged-4eaf9038-98d7-4312-8905-dba89af13ae4 for instance with vm_state active and task_state deleting.
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: INFO nova.compute.manager [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Took 0.85 seconds to detach 1 volumes for instance.
Apr 11 20:55:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Deleting volume: 5ad85d33-3ca5-44f2-86af-fa4d8044b37b {{(pid=71654) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:36 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Deleted allocations for instance 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ece1b957-d056-4c59-991f-a50dd034e79f tempest-TestShelveInstance-1168874819 tempest-TestShelveInstance-1168874819-project-member] Lock "93e7b2c8-565c-49ec-8dc2-c8a1489eab6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.837s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:37 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:55:37 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=26.153499603271484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:55:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:55:38 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:55:38 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:55:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:55:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:45 user nova-compute[71654]: INFO nova.compute.manager [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Terminating instance
Apr 11 20:55:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-vif-unplugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] No waiting events found dispatching network-vif-unplugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-5fb09ed7-42e3-48ee-ae28-c87b20da862a req-3ab241ff-b7e1-4368-b7b6-61a0d2710120 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-vif-unplugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:55:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Instance destroyed successfully.
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lazy-loading 'resources' on Instance uuid a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1708531122',display_name='tempest-AttachVolumeNegativeTest-server-1708531122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1708531122',id=32,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9M4nnLv9Kfngmmqa7wkotIEWs8NxuvYlnAPRxw7BkkUknV89fssNUDjI1CbZKjVpD+GtYJIY+uSuPWmyuAoezhPKAnxJuD6Sj0KDjy1vzY/LdFc26BOZVKvfXugfj6Zw==',key_name='tempest-keypair-603118687',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db28134878ba46528b7d5012ff9c7aff',ramdisk_id='',reservation_id='r-b04pm830',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1901377641',owner_user_name='tempest-AttachVolumeNegativeTest-1901377641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f69b01612974865be4e1e1b6a9bd570',uuid=a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converting VIF {"id": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "address": "fa:16:3e:9e:6d:2d", "network": {"id": "2e7f3602-ac71-4117-82aa-d6e25c53d5d0", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-257788394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db28134878ba46528b7d5012ff9c7aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c429f6b-6a", "ovs_interfaceid": "0c429f6b-6a13-4752-ab77-35aad97b9a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG os_vif [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c429f6b-6a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:46 user nova-compute[71654]: INFO os_vif [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=0c429f6b-6a13-4752-ab77-35aad97b9a10,network=Network(2e7f3602-ac71-4117-82aa-d6e25c53d5d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c429f6b-6a')
Apr 11 20:55:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Deleting instance files /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073_del
Apr 11 20:55:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Deletion of /opt/stack/data/nova/instances/a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073_del complete
Apr 11 20:55:46 user nova-compute[71654]: INFO nova.compute.manager [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 20:55:46 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:55:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:47 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Took 0.68 seconds to deallocate network for instance.
Apr 11 20:55:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-599550c4-85bd-4ae2-9e6b-e0e787b7744f req-977c6baf-789b-4c18-b5b7-d172b83a0cc6 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-vif-deleted-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:55:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:47 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Deleted allocations for instance a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073
Apr 11 20:55:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6652b7de-e82f-41f2-9d3a-04195c80fdf7 tempest-AttachVolumeNegativeTest-1901377641 tempest-AttachVolumeNegativeTest-1901377641-project-member] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received event network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:55:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Acquiring lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:55:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:55:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] Lock "a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:55:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] No waiting events found dispatching network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:55:48 user nova-compute[71654]: WARNING nova.compute.manager [req-1c655f46-7a78-461d-84a3-08df485c2e42 req-bc5954d5-00f1-49ef-8fe3-846a7d3a6f95 service nova] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Received unexpected event network-vif-plugged-0c429f6b-6a13-4752-ab77-35aad97b9a10 for instance with vm_state deleted and task_state None.
Apr 11 20:55:48 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246533.8534386, 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:55:48 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] VM Stopped (Lifecycle Event)
Apr 11 20:55:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c64ac733-01d5-4fce-be13-d00d8b2237e8 None None] [instance: 93e7b2c8-565c-49ec-8dc2-c8a1489eab6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:55:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:55:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:01 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246546.3977673, a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:56:01 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] VM Stopped (Lifecycle Event)
Apr 11 20:56:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a82b30ca-15e1-484c-aa0e-baccd443a851 None None] [instance: a8a4b0a6-0ef1-4ef3-815c-b2f80b0f1073] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:56:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:56:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:56:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:56:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:56:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:56:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:56:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:56:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:56:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:56:33 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:56:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8040MB free_disk=26.17136001586914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 20:56:36 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 20:56:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 20:56:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:56:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:56:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:56:38 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:56:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [{"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:56:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-097d9483-07ea-4dce-afd6-4d28dd0d2390" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:56:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:56:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:56:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 20:56:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:56:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:56:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:57:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:57:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:57:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:57:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:57:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing instance network info cache due to event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:57:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:57:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:57:10 user nova-compute[71654]: DEBUG nova.network.neutron [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:11 user nova-compute[71654]: INFO nova.compute.manager [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Detaching volume 15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230
Apr 11 20:57:11 user nova-compute[71654]: INFO nova.virt.block_device [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Attempting to driver detach volume 15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 from mountpoint /dev/vdb
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Attempting to detach device vdb from instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:57:11 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:57:11 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:57:11 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:57:11 user nova-compute[71654]:   <serial>15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230</serial>
Apr 11 20:57:11 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:57:11 user nova-compute[71654]: </disk>
Apr 11 20:57:11 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:57:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully detached device vdb from instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b from the persistent domain config.
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 20:57:11 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:57:11 user nova-compute[71654]:   <source dev="/dev/sde"/>
Apr 11 20:57:11 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 20:57:11 user nova-compute[71654]:   <serial>15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230</serial>
Apr 11 20:57:11 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 20:57:11 user nova-compute[71654]: </disk>
Apr 11 20:57:11 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updated VIF entry in instance network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d113c5ce-774c-4732-8602-3846bad62087 req-1bc316f8-6363-4dc4-85dd-68d780e56263 service nova] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681246631.7437944, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 20:57:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully detached device vdb from instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b from the live domain config.
Apr 11 20:57:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emIpWroR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:57:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77d33f-a73c-4d0b-b8bd-ebfd5e7d76f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:57:11 user nova-compute[71654]: No targets found.
Apr 11 20:57:11 user nova-compute[71654]: iSNS:
Apr 11 20:57:11 user nova-compute[71654]: No targets found.
Apr 11 20:57:11 user nova-compute[71654]: STATIC:
Apr 11 20:57:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230
Apr 11 20:57:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:57:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:57:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:57:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:11 user nova-compute[71654]: FIRMWARE:
Apr 11 20:57:11 user nova-compute[71654]: No targets found.
Apr 11 20:57:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:57:11 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:57:11 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ab76b-0bd8-4fa9-a125-fb4f3f3f9cd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ac39dd-a11a-4f0f-a071-8bdc27a3779d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:11 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:57:11 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:57:11 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:11 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:57:11 user nova-compute[71654]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 (non-flash)
Apr 11 20:57:11 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb38154310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230'): ({'sde'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Removing single pathed devices sde {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b8a9c-287c-41bc-a9d1-acd4cd8d9a1b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3725bfa7-3781-4415-948f-9fcc8d71f4d4]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Flushing IO for device /dev/sde {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f755a-59de-4a35-bb43-a60f2d8c988f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5253143-b87c-4e57-8e80-e515e6248266]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] SCSI volumes sde have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[558ce933-a09c-4132-908f-dd8c3ec5bef4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a72e13-809c-4667-9932-b4bb92299bb6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260]
Apr 11 20:57:12 user nova-compute[71654]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230, portal: 172.16.0.220,3260] successful.
Apr 11 20:57:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15b2b9bb-995c-4bc4-bdc8-ecc2fdaae230 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[840bb1e5-c49f-42fd-838b-873352c61060]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] <== disconnect_volume: return (318ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing instance network info cache due to event network-changed-6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Acquiring lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Acquired lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG nova.network.neutron [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Refreshing network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:57:12 user nova-compute[71654]: DEBUG nova.objects.instance [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'flavor' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:57:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-81330baf-df67-48e1-82be-3ed6c89eb74e tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.964s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:13 user nova-compute[71654]: DEBUG nova.network.neutron [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updated VIF entry in instance network info cache for port 6cba1d9f-880d-4dbe-9315-db1ba21cb865. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:57:13 user nova-compute[71654]: DEBUG nova.network.neutron [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [{"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:57:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7e2f8fce-9174-4131-86b0-e1e5e2744870 req-6a607f0f-84ca-41b6-8dc8-2a0f52b5017d service nova] Releasing lock "refresh_cache-3be648d4-6469-4c11-a51b-06c3fb4c9a6b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:57:14 user nova-compute[71654]: INFO nova.compute.manager [None req-8ff4a2ea-c931-4645-93be-9e985aaf4204 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Get console output
Apr 11 20:57:14 user nova-compute[71654]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:14 user nova-compute[71654]: INFO nova.compute.manager [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Terminating instance
Apr 11 20:57:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:57:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-462da866-1879-46f4-b9fa-daf72933e04d req-49df3a4f-51e3-4f87-9869-c538f71ac8ea service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-unplugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:57:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Instance destroyed successfully.
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.objects.instance [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'resources' on Instance uuid ead4cb65-5fee-46c2-8e8a-3cb846e963b0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-494251155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-494251155',id=31,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:53:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-d1065dnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:55:28Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=ead4cb65-5fee-46c2-8e8a-3cb846e963b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "bc598d8b-b02e-429d-895b-c553ab0a415a", "address": "fa:16:3e:e9:e3:aa", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc598d8b-b0", "ovs_interfaceid": "bc598d8b-b02e-429d-895b-c553ab0a415a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_vif [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc598d8b-b0, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:57:15 user nova-compute[71654]: INFO os_vif [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:e3:aa,bridge_name='br-int',has_traffic_filtering=True,id=bc598d8b-b02e-429d-895b-c553ab0a415a,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc598d8b-b0')
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psxjPFVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:57:15 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[89920ebf-b22f-4445-8bc0-84b778b1ab75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:57:15 user nova-compute[71654]: No targets found.
Apr 11 20:57:15 user nova-compute[71654]: iSNS:
Apr 11 20:57:15 user nova-compute[71654]: No targets found.
Apr 11 20:57:15 user nova-compute[71654]: STATIC:
Apr 11 20:57:15 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b
Apr 11 20:57:15 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:15 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:15 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:57:15 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:15 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:15 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:57:15 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:57:15 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:57:15 user nova-compute[71654]: FIRMWARE:
Apr 11 20:57:15 user nova-compute[71654]: No targets found.
Apr 11 20:57:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:57:15 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:57:15 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd42b366-c6b4-430c-895b-5fa17cd9fbee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b36edc5-6f2d-45a5-9adc-bff8e8f0e666]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:15 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:57:15 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:15 user nova-compute[71654]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b (non-flash)
Apr 11 20:57:15 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb381377f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db8971-b517-4135-97aa-9df99ece0746]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f7576-2394-4699-b69e-71fcd7b8684b]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[56682688-4448-4cd2-b141-29030e124b10]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16cfeb7-65dc-4919-8d9d-810728ac7ed8]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e9bf3-54b0-4d8c-a9f2-a06116d3a432]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd7d88-540f-4880-829a-0e6104f283fb]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260]
Apr 11 20:57:15 user nova-compute[71654]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b, portal: 172.16.0.220,3260] successful.
Apr 11 20:57:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41840788-b0a2-4ee3-a6c0-6bd063cc2f3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d5c63e-cd53-4a2d-ba38-8463368a3685]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== disconnect_volume: return (326ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:57:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Deleting instance files /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0_del
Apr 11 20:57:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Deletion of /opt/stack/data/nova/instances/ead4cb65-5fee-46c2-8e8a-3cb846e963b0_del complete
Apr 11 20:57:15 user nova-compute[71654]: INFO nova.compute.manager [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 20:57:15 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:57:15 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:57:16 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Took 0.58 seconds to deallocate network for instance.
Apr 11 20:57:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-48eb5a9f-d7a8-4d66-941b-28d6047a551d req-08a694d7-e9be-4e78-a870-b4fd305ea9f5 service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-deleted-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Acquiring lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] No waiting events found dispatching network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:57:16 user nova-compute[71654]: WARNING nova.compute.manager [req-0cc328e0-0622-4402-b35a-0f890a1c314f req-608abbab-9112-423d-9905-71feb8861fcf service nova] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Received unexpected event network-vif-plugged-bc598d8b-b02e-429d-895b-c553ab0a415a for instance with vm_state active and task_state deleting.
Apr 11 20:57:16 user nova-compute[71654]: INFO nova.compute.manager [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Took 0.78 seconds to detach 1 volumes for instance.
Apr 11 20:57:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:16 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:17 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:57:17 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:57:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:17 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Deleted allocations for instance ead4cb65-5fee-46c2-8e8a-3cb846e963b0
Apr 11 20:57:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-a352549e-aa2c-438e-b78f-5f4afe105da1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "ead4cb65-5fee-46c2-8e8a-3cb846e963b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.055s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:24 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:24 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:57:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:30 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246635.0343065, ead4cb65-5fee-46c2-8e8a-3cb846e963b0 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:57:30 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] VM Stopped (Lifecycle Event)
Apr 11 20:57:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e4c3733d-038f-4393-b4f2-a7ce221ad2c4 None None] [instance: ead4cb65-5fee-46c2-8e8a-3cb846e963b0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:57:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:33 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:57:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=26.150497436523438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:57:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:57:37 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:57:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:57:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:57:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 20:57:39 user nova-compute[71654]: INFO nova.compute.claims [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Claim successful on node user
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Updating instance_info_cache with network_info: [{"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 20:57:39 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 20:57:39 user nova-compute[71654]: INFO nova.virt.block_device [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Booting with volume snapshot 3538ee04-0bfc-4596-bb6f-d4e5082ee7d6 at /dev/vda
Apr 11 20:57:39 user nova-compute[71654]: DEBUG nova.policy [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 20:57:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:40 user nova-compute[71654]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Successfully created port: 1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Successfully updated port: 1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "refresh_cache-b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquired lock "refresh_cache-b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.compute.manager [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-changed-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.compute.manager [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Refreshing instance network info cache due to event network-changed-1e785af1-7b60-43ee-a29c-9a9f377d7784. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Acquiring lock "refresh_cache-b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Updating instance_info_cache with network_info: [{"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Releasing lock "refresh_cache-b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Instance network_info: |[{"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Acquired lock "refresh_cache-b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:57:41 user nova-compute[71654]: DEBUG nova.network.neutron [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Refreshing network info cache for port 1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 20:57:42 user nova-compute[71654]: DEBUG nova.network.neutron [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Updated VIF entry in instance network info cache for port 1e785af1-7b60-43ee-a29c-9a9f377d7784. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 20:57:42 user nova-compute[71654]: DEBUG nova.network.neutron [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Updating instance_info_cache with network_info: [{"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:57:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8e84f7ed-ab4c-43fb-97b1-0e9121663c0e req-ec0b0206-dfbf-4f56-9d6e-e423c1ef4e5a service nova] Releasing lock "refresh_cache-b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:57:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG os_brick.utils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cec262-98b1-4fbe-9add-47f3c854c251]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379c9af-c538-4c3e-b024-18dba13efa8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f2096c-6dd3-4cf7-ae59-f8f080e7be33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5798273-cadf-404a-8896-9238ef13fa70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 20:57:45 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 20:57:45 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03aa02-de80-4084-bcbe-aadb5fdb7e4c]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG os_brick.utils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:57:45 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Updating existing volume attachment record: 336a0a8f-46d1-4472-abc0-268f8b79e0e8 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 20:57:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 20:57:49 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Creating image(s)
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Ensure instance console log exists: /opt/stack/data/nova/instances/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Start _get_guest_xml network_info=[{"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqEAdxgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d', 'attached_at': '', 'detached_at': '', 'volume_id': '4630c311-564e-41c7-9c17-5a541be37688', 'serial': '4630c311-564e-41c7-9c17-5a541be37688'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '336a0a8f-46d1-4472-abc0-268f8b79e0e8', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 20:57:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:57:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqEAdxgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:57:49 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:57:49 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:57:49 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e400b379-c106-4a19-a2f8-30ea118505c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 20:57:49 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af32330-aa5f-4f60-b89d-2cf22eed64f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688] added
Apr 11 20:57:49 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd68cf-06bd-406a-88a9-5029291bfeb3]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:49 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f1bc61-e936-46af-b6c4-9f9a09474eeb]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqEAdxgF {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UqEAdxgF" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fb9d47-dd1f-4b6b-8cea-793b2a574f55]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UqEAdxgF'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec18c4-2ab2-4494-a221-0de7fbac0981]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7d0667-aebc-44a7-872d-4ca56045f8ee]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:50 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:50 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:50 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:50 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ca9c8d-b32d-4184-94dd-f8adf8540c58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260]
Apr 11 20:57:50 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260] successful.
Apr 11 20:57:50 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[be871103-f8ff-454b-8d93-8c15a2024948]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6cba14-0915-4993-a41e-0027bc5cc235]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:50 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:50 user nova-compute[71654]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:57:50 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:57:50 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:57:50 user nova-compute[71654]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:57:50 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[01067108-a852-462a-aa24-ea550d45a890]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 20:57:50 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqEAdxgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26136653965376632', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136653965376632', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-793939995',display_name='tempest-TestVolumeBootPattern-server-793939995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-793939995',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-5exo6wbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:57:40Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'pci_devices' on Instance uuid b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 20:57:51 user nova-compute[71654]:   <uuid>b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d</uuid>
Apr 11 20:57:51 user nova-compute[71654]:   <name>instance-00000021</name>
Apr 11 20:57:51 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 20:57:51 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 20:57:51 user nova-compute[71654]:   <metadata>
Apr 11 20:57:51 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 20:57:51 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 20:57:51 user nova-compute[71654]:       <nova:name>tempest-TestVolumeBootPattern-server-793939995</nova:name>
Apr 11 20:57:51 user nova-compute[71654]:       <nova:creationTime>2023-04-11 20:57:49</nova:creationTime>
Apr 11 20:57:51 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 20:57:51 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 20:57:51 user nova-compute[71654]:       </nova:flavor>
Apr 11 20:57:51 user nova-compute[71654]:       <nova:owner>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:user uuid="3e34c9542bd64328a3c8d5cdb7421917">tempest-TestVolumeBootPattern-221737316-project-member</nova:user>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:project uuid="2c36c3a15f2a413e81544f65c4f6ede4">tempest-TestVolumeBootPattern-221737316</nova:project>
Apr 11 20:57:51 user nova-compute[71654]:       </nova:owner>
Apr 11 20:57:51 user nova-compute[71654]:       <nova:ports>
Apr 11 20:57:51 user nova-compute[71654]:         <nova:port uuid="1e785af1-7b60-43ee-a29c-9a9f377d7784">
Apr 11 20:57:51 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 20:57:51 user nova-compute[71654]:         </nova:port>
Apr 11 20:57:51 user nova-compute[71654]:       </nova:ports>
Apr 11 20:57:51 user nova-compute[71654]:     </nova:instance>
Apr 11 20:57:51 user nova-compute[71654]:   </metadata>
Apr 11 20:57:51 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 20:57:51 user nova-compute[71654]:     <system>
Apr 11 20:57:51 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 20:57:51 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 20:57:51 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 20:57:51 user nova-compute[71654]:       <entry name="serial">b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d</entry>
Apr 11 20:57:51 user nova-compute[71654]:       <entry name="uuid">b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d</entry>
Apr 11 20:57:51 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 20:57:51 user nova-compute[71654]:     </system>
Apr 11 20:57:51 user nova-compute[71654]:   </sysinfo>
Apr 11 20:57:51 user nova-compute[71654]:   <os>
Apr 11 20:57:51 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 20:57:51 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 20:57:51 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 20:57:51 user nova-compute[71654]:   </os>
Apr 11 20:57:51 user nova-compute[71654]:   <features>
Apr 11 20:57:51 user nova-compute[71654]:     <acpi/>
Apr 11 20:57:51 user nova-compute[71654]:     <apic/>
Apr 11 20:57:51 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 20:57:51 user nova-compute[71654]:   </features>
Apr 11 20:57:51 user nova-compute[71654]:   <clock offset="utc">
Apr 11 20:57:51 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 20:57:51 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 20:57:51 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 20:57:51 user nova-compute[71654]:   </clock>
Apr 11 20:57:51 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 20:57:51 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 20:57:51 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 20:57:51 user nova-compute[71654]:   </cpu>
Apr 11 20:57:51 user nova-compute[71654]:   <devices>
Apr 11 20:57:51 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 20:57:51 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 20:57:51 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 20:57:51 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 20:57:51 user nova-compute[71654]:       <serial>4630c311-564e-41c7-9c17-5a541be37688</serial>
Apr 11 20:57:51 user nova-compute[71654]:     </disk>
Apr 11 20:57:51 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 20:57:51 user nova-compute[71654]:       <mac address="fa:16:3e:26:bf:46"/>
Apr 11 20:57:51 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:57:51 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 20:57:51 user nova-compute[71654]:       <target dev="tap1e785af1-7b"/>
Apr 11 20:57:51 user nova-compute[71654]:     </interface>
Apr 11 20:57:51 user nova-compute[71654]:     <serial type="pty">
Apr 11 20:57:51 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d/console.log" append="off"/>
Apr 11 20:57:51 user nova-compute[71654]:     </serial>
Apr 11 20:57:51 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 20:57:51 user nova-compute[71654]:     <video>
Apr 11 20:57:51 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 20:57:51 user nova-compute[71654]:     </video>
Apr 11 20:57:51 user nova-compute[71654]:     <rng model="virtio">
Apr 11 20:57:51 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 20:57:51 user nova-compute[71654]:     </rng>
Apr 11 20:57:51 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 20:57:51 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 20:57:51 user nova-compute[71654]:       <stats period="10"/>
Apr 11 20:57:51 user nova-compute[71654]:     </memballoon>
Apr 11 20:57:51 user nova-compute[71654]:   </devices>
Apr 11 20:57:51 user nova-compute[71654]: </domain>
Apr 11 20:57:51 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-793939995',display_name='tempest-TestVolumeBootPattern-server-793939995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-793939995',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-5exo6wbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T20:57:40Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG os_vif [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e785af1-7b, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e785af1-7b, col_values=(('external_ids', {'iface-id': '1e785af1-7b60-43ee-a29c-9a9f377d7784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:bf:46', 'vm-uuid': 'b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:51 user nova-compute[71654]: INFO os_vif [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b')
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 20:57:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No VIF found with MAC fa:16:3e:26:bf:46, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] No waiting events found dispatching network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:57:52 user nova-compute[71654]: WARNING nova.compute.manager [req-0371a831-9ea4-4385-8f32-1ae106248639 req-24bc2e77-d62a-4056-9601-ec5a842526e7 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received unexpected event network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance with vm_state building and task_state spawning.
Apr 11 20:57:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246674.9154804, b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:57:54 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] VM Resumed (Lifecycle Event)
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 20:57:54 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Instance spawned successfully.
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:57:54 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246674.9171114, b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:57:54 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] VM Started (Lifecycle Event)
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:57:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 20:57:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:57:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:57:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:57:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] No waiting events found dispatching network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:57:55 user nova-compute[71654]: WARNING nova.compute.manager [req-9def5242-2e03-4280-83c2-33db9637e76d req-737ccdf5-e55d-4a93-a1e6-49053e75823c service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received unexpected event network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance with vm_state building and task_state spawning.
Apr 11 20:57:55 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 20:57:55 user nova-compute[71654]: INFO nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 11 20:57:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:57:55 user nova-compute[71654]: INFO nova.compute.manager [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Took 15.89 seconds to build instance.
Apr 11 20:57:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-91169d68-7e33-40e3-8448-a07cafff63cf tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.982s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:57:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:57:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:01 user nova-compute[71654]: INFO nova.compute.manager [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Terminating instance
Apr 11 20:58:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-460a9628-c534-4c2e-b1e8-627f26fbfad6 req-d7431780-4a33-48e3-ae32-0de1612eaaa1 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-unplugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Instance destroyed successfully.
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'resources' on Instance uuid 3be648d4-6469-4c11-a51b-06c3fb4c9a6b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1225023406',display_name='tempest-ServerRescueNegativeTestJSON-server-1225023406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1225023406',id=29,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4x6uP246VWRPkKSeoaF0rKad7haM9o+g0vO55lyTBMphQrGzfiAPwPyJOIeXbxZxLBgRKOqIaGp/M0eiVeOUEpldUvWk5YlfA9kM4Hp1+g48Kwhly6qXWHqLhlF/xwtA==',key_name='tempest-keypair-440521057',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-8g0g1nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=3be648d4-6469-4c11-a51b-06c3fb4c9a6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "address": "fa:16:3e:ae:c8:b4", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cba1d9f-88", "ovs_interfaceid": "6cba1d9f-880d-4dbe-9315-db1ba21cb865", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG os_vif [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cba1d9f-88, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:58:02 user nova-compute[71654]: INFO os_vif [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:c8:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cba1d9f-880d-4dbe-9315-db1ba21cb865,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cba1d9f-88')
Apr 11 20:58:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Deleting instance files /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b_del
Apr 11 20:58:02 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Deletion of /opt/stack/data/nova/instances/3be648d4-6469-4c11-a51b-06c3fb4c9a6b_del complete
Apr 11 20:58:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:02 user nova-compute[71654]: INFO nova.compute.manager [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 20:58:02 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:58:02 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:58:02 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Took 0.74 seconds to deallocate network for instance.
Apr 11 20:58:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-045f49c7-53d9-4311-88f8-910ba84a650c req-32ef9796-55a8-42fa-89c6-a40984819b6d service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-deleted-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:03 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Deleted allocations for instance 3be648d4-6469-4c11-a51b-06c3fb4c9a6b
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c13e4923-9cea-45ee-9685-01e54362ffe5 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Acquiring lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] Lock "3be648d4-6469-4c11-a51b-06c3fb4c9a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:03 user nova-compute[71654]: DEBUG nova.compute.manager [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] No waiting events found dispatching network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:03 user nova-compute[71654]: WARNING nova.compute.manager [req-38f4e02d-f629-4fec-9417-bf7b35ef5131 req-be238dca-80f5-46d2-a6c1-bacf81b946b0 service nova] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Received unexpected event network-vif-plugged-6cba1d9f-880d-4dbe-9315-db1ba21cb865 for instance with vm_state deleted and task_state None.
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:05 user nova-compute[71654]: INFO nova.compute.manager [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Terminating instance
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-vif-unplugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] No waiting events found dispatching network-vif-unplugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-7c44e690-25b6-4576-8f4c-8f4bd776687b req-4f622b0e-7964-4553-8ba1-7b7ead495656 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-vif-unplugged-81b40e8f-efea-4c1a-8153-999d8b566b81 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Instance destroyed successfully.
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'resources' on Instance uuid 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-88977129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-88977129',id=24,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-hlyd5z68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:50:40Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=9cd9582e-3d22-4d3d-8c25-e9274fbb55b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "81b40e8f-efea-4c1a-8153-999d8b566b81", "address": "fa:16:3e:b2:95:7b", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b40e8f-ef", "ovs_interfaceid": "81b40e8f-efea-4c1a-8153-999d8b566b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG os_vif [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b40e8f-ef, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:05 user nova-compute[71654]: INFO os_vif [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:95:7b,bridge_name='br-int',has_traffic_filtering=True,id=81b40e8f-efea-4c1a-8153-999d8b566b81,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b40e8f-ef')
Apr 11 20:58:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Deleting instance files /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3_del
Apr 11 20:58:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Deletion of /opt/stack/data/nova/instances/9cd9582e-3d22-4d3d-8c25-e9274fbb55b3_del complete
Apr 11 20:58:05 user nova-compute[71654]: INFO nova.compute.manager [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 20:58:05 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:58:05 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:58:06 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:58:06 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Took 0.69 seconds to deallocate network for instance.
Apr 11 20:58:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:06 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:58:06 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:58:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:06 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Deleted allocations for instance 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3
Apr 11 20:58:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-ff8b49d1-afae-4d8a-aaf5-20e13112680f tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.848s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Acquiring lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] Lock "9cd9582e-3d22-4d3d-8c25-e9274fbb55b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] No waiting events found dispatching network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:07 user nova-compute[71654]: WARNING nova.compute.manager [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received unexpected event network-vif-plugged-81b40e8f-efea-4c1a-8153-999d8b566b81 for instance with vm_state deleted and task_state None.
Apr 11 20:58:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-095c008f-69ec-4ee1-9310-b9e19a1b694e req-a579a6b4-f116-4dc6-9d3a-c911cf2ff0c5 service nova] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Received event network-vif-deleted-81b40e8f-efea-4c1a-8153-999d8b566b81 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:14 user nova-compute[71654]: INFO nova.compute.manager [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Terminating instance
Apr 11 20:58:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:58:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-unplugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-unplugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-50dfeb27-e50f-4b31-844b-3a995a62c509 req-773df375-e97b-4cc0-8d55-f5d4de85eea3 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-unplugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Instance destroyed successfully.
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:51:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1177514325',display_name='tempest-ServerActionsTestJSON-server-1177514325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1177514325',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-ej100p75',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=49dc4f46-eb33-4fc8-ba2a-59140b9a64c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "87a70211-de9a-40c1-b767-97cff2871ab3", "address": "fa:16:3e:f1:4a:c8", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87a70211-de", "ovs_interfaceid": "87a70211-de9a-40c1-b767-97cff2871ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_vif [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87a70211-de, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:58:15 user nova-compute[71654]: INFO os_vif [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=87a70211-de9a-40c1-b767-97cff2871ab3,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87a70211-de')
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgjLMib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:58:15 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6500753-df34-4a1f-8810-91f391544a69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:58:15 user nova-compute[71654]: No targets found.
Apr 11 20:58:15 user nova-compute[71654]: iSNS:
Apr 11 20:58:15 user nova-compute[71654]: No targets found.
Apr 11 20:58:15 user nova-compute[71654]: STATIC:
Apr 11 20:58:15 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:58:15 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:58:15 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:58:15 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e
Apr 11 20:58:15 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:58:15 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:58:15 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688
Apr 11 20:58:15 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:58:15 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:58:15 user nova-compute[71654]: FIRMWARE:
Apr 11 20:58:15 user nova-compute[71654]: No targets found.
Apr 11 20:58:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:58:15 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:58:15 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f89498-d8e5-4a6b-a80c-b6772a3879fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e1da3-1aca-44f6-b457-c5eb58e61487]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:58:15 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:58:15 user nova-compute[71654]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:58:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:58:15 user nova-compute[71654]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e (non-flash)
Apr 11 20:58:15 user nova-compute[71654]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:58:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb4073dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e'): ({'sdd'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Removing single pathed devices sdd {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f1259-44eb-46d6-9e0d-54c47e5b59be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6e1347-0ebb-438a-bbd7-44c520448766]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Flushing IO for device /dev/sdd {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef1ce35-20ce-47ec-8423-0b74f37ca9e0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e169d561-36d0-41bd-9bcc-d84b46127ab5]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] SCSI volumes sdd have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23564316562336134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e74b737', '/dev/disk/by-id/scsi-1SCST_BIO1e74b737-5d1eb3a43d7f5ade') {{(pid=81862) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e39e2-4fa1-47f6-ad71-043c27e42eef]: (4, None) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadfa28d-fad4-4e59-9a1f-8ad33b9c67ae]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb79b72-1e05-4e9c-ab80-6ff6f8a67c6f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260]
Apr 11 20:58:15 user nova-compute[71654]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e, portal: 172.16.0.220,3260] successful.
Apr 11 20:58:15 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e9baedf-a70c-41a1-8578-21a40984963e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf396f-76a7-4e2a-aba0-ab0e402b91dc]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] <== disconnect_volume: return (324ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:58:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Deleting instance files /opt/stack/data/nova/instances/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6_del
Apr 11 20:58:15 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Deletion of /opt/stack/data/nova/instances/49dc4f46-eb33-4fc8-ba2a-59140b9a64c6_del complete
Apr 11 20:58:15 user nova-compute[71654]: INFO nova.compute.manager [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 11 20:58:15 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:58:15 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:58:16 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:58:16 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Took 0.68 seconds to deallocate network for instance.
Apr 11 20:58:16 user nova-compute[71654]: DEBUG nova.compute.manager [req-5a30da5e-3461-4e20-b444-e9b0ec85526e req-80764e2a-608b-4948-8d7a-7a3eadf7f17d service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-deleted-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Acquiring lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] No waiting events found dispatching network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:17 user nova-compute[71654]: WARNING nova.compute.manager [req-eae1e1c5-ec35-4cd4-aeb8-925178beea60 req-6be9bea9-7b2b-4c93-a8a2-39ff7139c013 service nova] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Received unexpected event network-vif-plugged-87a70211-de9a-40c1-b767-97cff2871ab3 for instance with vm_state active and task_state deleting.
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246682.151497, 3be648d4-6469-4c11-a51b-06c3fb4c9a6b => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:58:17 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] VM Stopped (Lifecycle Event)
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-95b6396d-f019-4e56-b988-62a1c81a334b None None] [instance: 3be648d4-6469-4c11-a51b-06c3fb4c9a6b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:17 user nova-compute[71654]: INFO nova.compute.manager [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Took 0.83 seconds to detach 1 volumes for instance.
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Deleting volume: 2e9baedf-a70c-41a1-8578-21a40984963e {{(pid=71654) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:58:17 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:58:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:18 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Deleted allocations for instance 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6
Apr 11 20:58:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2b9b68cd-8422-43aa-b6ab-53ed81ba6d5e tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "49dc4f46-eb33-4fc8-ba2a-59140b9a64c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.415s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:20 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246685.5982041, 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:58:20 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] VM Stopped (Lifecycle Event)
Apr 11 20:58:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-00764b9b-eddd-4692-8d04-9ff8291a5f5f None None] [instance: 9cd9582e-3d22-4d3d-8c25-e9274fbb55b3] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:58:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:58:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:30 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246695.5028007, 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:58:30 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] VM Stopped (Lifecycle Event)
Apr 11 20:58:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-9fd80817-46be-46b6-ab1d-992ae07ec17b None None] [instance: 49dc4f46-eb33-4fc8-ba2a-59140b9a64c6] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:58:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:34 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 20:58:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:58:36 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:58:36 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=26.251453399658203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 764a059b-9ded-4d53-b960-ced4abe4323d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 097d9483-07ea-4dce-afd6-4d28dd0d2390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:58:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [{"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-27573de4-b3dc-48ad-b1dc-11c3cb206670" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 20:58:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:58:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:58:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:55 user nova-compute[71654]: INFO nova.compute.manager [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Terminating instance
Apr 11 20:58:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-4eac8139-c0ae-468d-894f-9f795c6a5455 req-3fad851c-62e1-448c-bed9-f16591dc932d service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-unplugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Instance destroyed successfully.
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'resources' on Instance uuid 097d9483-07ea-4dce-afd6-4d28dd0d2390 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-565746598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-565746598',id=19,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-pepmmnwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:46:57Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=097d9483-07ea-4dce-afd6-4d28dd0d2390,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "address": "fa:16:3e:11:00:a4", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d88bcd7-9d", "ovs_interfaceid": "4d88bcd7-9de8-4278-9490-d4c866efebc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_vif [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d88bcd7-9d, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:58:56 user nova-compute[71654]: INFO os_vif [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:00:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d88bcd7-9de8-4278-9490-d4c866efebc4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d88bcd7-9d')
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkfhbGRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:58:56 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[94953e16-aae5-427b-874d-6d3b80b1d0da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:58:56 user nova-compute[71654]: No targets found.
Apr 11 20:58:56 user nova-compute[71654]: iSNS:
Apr 11 20:58:56 user nova-compute[71654]: No targets found.
Apr 11 20:58:56 user nova-compute[71654]: STATIC:
Apr 11 20:58:56 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b
Apr 11 20:58:56 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:58:56 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:58:56 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688
Apr 11 20:58:56 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:58:56 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:58:56 user nova-compute[71654]: FIRMWARE:
Apr 11 20:58:56 user nova-compute[71654]: No targets found.
Apr 11 20:58:56 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:58:56 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:58:56 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc844c6-238d-486c-9020-fcdd1316bafc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cfce64-d898-4e1c-83ac-af1b030f49b6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:58:56 user nova-compute[71654]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:58:56 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b (non-flash)
Apr 11 20:58:56 user nova-compute[71654]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:58:56 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e22050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b765f55-eeda-485a-8bcd-3f96591d5b36]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd51899-5afa-4226-8e71-79d7316e42c8]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada39ea7-0cf2-4dde-b775-94fe0f8925b8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b108de-7fa9-4782-a113-67e64b5acf7a]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[05beca4c-18fd-402d-b9bd-d92850780645]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[34229b3f-998e-4272-9381-ea926bd5f20a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260]
Apr 11 20:58:56 user nova-compute[71654]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b, portal: 172.16.0.220,3260] successful.
Apr 11 20:58:56 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625f97cf-09c8-456b-92ae-a757e4e74f3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c2cc02-366a-404b-a8f0-11e74f0c6b51]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] <== disconnect_volume: return (289ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:58:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Deleting instance files /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390_del
Apr 11 20:58:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Deletion of /opt/stack/data/nova/instances/097d9483-07ea-4dce-afd6-4d28dd0d2390_del complete
Apr 11 20:58:56 user nova-compute[71654]: INFO nova.compute.manager [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "764a059b-9ded-4d53-b960-ced4abe4323d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:56 user nova-compute[71654]: INFO nova.compute.manager [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Terminating instance
Apr 11 20:58:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:58:57 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Took 0.50 seconds to deallocate network for instance.
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-aa97a743-74ae-40de-8aac-8d1dff3bb5e2 req-1c572f0a-45f3-4f4e-a26a-52042a37af70 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-deleted-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Instance destroyed successfully.
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'resources' on Instance uuid 764a059b-9ded-4d53-b960-ced4abe4323d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-57617171',display_name='tempest-ServerRescueNegativeTestJSON-server-57617171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-57617171',id=18,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-d9rxhm4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:44:56Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=764a059b-9ded-4d53-b960-ced4abe4323d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "4698b719-9a11-4eae-9a8d-d736723b13bb", "address": "fa:16:3e:83:1a:7b", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4698b719-9a", "ovs_interfaceid": "4698b719-9a11-4eae-9a8d-d736723b13bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG os_vif [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4698b719-9a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Acquiring lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] No waiting events found dispatching network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:57 user nova-compute[71654]: WARNING nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Received unexpected event network-vif-plugged-4d88bcd7-9de8-4278-9490-d4c866efebc4 for instance with vm_state active and task_state deleting.
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:57 user nova-compute[71654]: WARNING nova.compute.manager [req-3b70f4c0-43eb-45b7-8c53-4fb50af6062d req-12a0a4de-730d-4527-bdd1-5978437be994 service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state rescued and task_state deleting.
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:58:57 user nova-compute[71654]: INFO os_vif [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=4698b719-9a11-4eae-9a8d-d736723b13bb,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4698b719-9a')
Apr 11 20:58:57 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Deleting instance files /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d_del
Apr 11 20:58:57 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Deletion of /opt/stack/data/nova/instances/764a059b-9ded-4d53-b960-ced4abe4323d_del complete
Apr 11 20:58:57 user nova-compute[71654]: INFO nova.compute.manager [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 20:58:57 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:57 user nova-compute[71654]: INFO nova.compute.manager [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Took 0.82 seconds to detach 1 volumes for instance.
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:58 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Deleted allocations for instance 097d9483-07ea-4dce-afd6-4d28dd0d2390
Apr 11 20:58:58 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:58:58 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Took 0.53 seconds to deallocate network for instance.
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5577ee9a-35ce-4ea7-acec-67ecd2417578 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "097d9483-07ea-4dce-afd6-4d28dd0d2390" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.935s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:58 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Deleted allocations for instance 764a059b-9ded-4d53-b960-ced4abe4323d
Apr 11 20:58:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5d66dba6-abda-4a27-b30d-ea6470882231 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "764a059b-9ded-4d53-b960-ced4abe4323d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-39692afd-a320-4a08-b27c-497ce8ae798f req-a7456476-6d25-4b2f-b657-0368bfebba8c service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-deleted-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:59 user nova-compute[71654]: WARNING nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state deleted and task_state None.
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:59 user nova-compute[71654]: WARNING nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state deleted and task_state None.
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:59 user nova-compute[71654]: WARNING nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-unplugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state deleted and task_state None.
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Acquiring lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] Lock "764a059b-9ded-4d53-b960-ced4abe4323d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:58:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] No waiting events found dispatching network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:58:59 user nova-compute[71654]: WARNING nova.compute.manager [req-21fa2018-90a3-4162-a321-4e8ebda19304 req-9fa13414-88d6-4fb9-bc0e-5eed2eb3d38d service nova] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Received unexpected event network-vif-plugged-4698b719-9a11-4eae-9a8d-d736723b13bb for instance with vm_state deleted and task_state None.
Apr 11 20:59:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:05 user nova-compute[71654]: INFO nova.compute.manager [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Terminating instance
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-vif-unplugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] No waiting events found dispatching network-vif-unplugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.compute.manager [req-d020bcd5-c2eb-4433-a86d-f383b20596bd req-71d8ecf3-a7ec-4371-8a38-547839720309 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-vif-unplugged-a5b56921-0469-48f8-bbe7-b4106babb386 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Instance destroyed successfully.
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lazy-loading 'resources' on Instance uuid 27573de4-b3dc-48ad-b1dc-11c3cb206670 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1870482065',display_name='tempest-ServerActionsTestJSON-server-1870482065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1870482065',id=26,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkzNdStuc7o6CZRIQ7vLpRQGYZBjRREEfBBjkRkXgnIpGnRtlDowOt1rBVqbZbwKYlLeMNhQ6se3H08qyA/D5cDdf0Ka0GwbuGseCRlIXjFsAQgZaJPwzBYuiNsPYC1BA==',key_name='tempest-keypair-1169091087',keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d0c94dce35b4883940b8399d6d0ba7e',ramdisk_id='',reservation_id='r-zflj9yhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-633772522',owner_user_name='tempest-ServerActionsTestJSON-633772522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7736d32586e949e4839f826f18994a0f',uuid=27573de4-b3dc-48ad-b1dc-11c3cb206670,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converting VIF {"id": "a5b56921-0469-48f8-bbe7-b4106babb386", "address": "fa:16:3e:8d:ea:b7", "network": {"id": "d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021591232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d0c94dce35b4883940b8399d6d0ba7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b56921-04", "ovs_interfaceid": "a5b56921-0469-48f8-bbe7-b4106babb386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG os_vif [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5b56921-04, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:59:05 user nova-compute[71654]: INFO os_vif [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ea:b7,bridge_name='br-int',has_traffic_filtering=True,id=a5b56921-0469-48f8-bbe7-b4106babb386,network=Network(d45ba6b4-4aac-4d6f-92f4-bf29e74eb34c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b56921-04')
Apr 11 20:59:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Deleting instance files /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670_del
Apr 11 20:59:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Deletion of /opt/stack/data/nova/instances/27573de4-b3dc-48ad-b1dc-11c3cb206670_del complete
Apr 11 20:59:05 user nova-compute[71654]: INFO nova.compute.manager [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 20:59:05 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:59:05 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:06 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Took 0.45 seconds to deallocate network for instance.
Apr 11 20:59:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-vif-deleted-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:06 user nova-compute[71654]: INFO nova.compute.manager [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Neutron deleted interface a5b56921-0469-48f8-bbe7-b4106babb386; detaching it from the instance and deleting it from the info cache
Apr 11 20:59:06 user nova-compute[71654]: DEBUG nova.network.neutron [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-16d40761-69d9-4430-98a4-fde025ba3735 req-aff8b91d-4555-4bcb-a6cf-f3abd4bceb61 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Detach interface failed, port_id=a5b56921-0469-48f8-bbe7-b4106babb386, reason: Instance 27573de4-b3dc-48ad-b1dc-11c3cb206670 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:59:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:06 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Deleted allocations for instance 27573de4-b3dc-48ad-b1dc-11c3cb206670
Apr 11 20:59:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-1c51c773-5f2c-422b-99aa-6f6d60a99590 tempest-ServerActionsTestJSON-633772522 tempest-ServerActionsTestJSON-633772522-project-member] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.512s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received event network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Acquiring lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] Lock "27573de4-b3dc-48ad-b1dc-11c3cb206670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] No waiting events found dispatching network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:07 user nova-compute[71654]: WARNING nova.compute.manager [req-d21ba802-e371-4d2f-baf6-0905d835ae16 req-ab7defd4-3489-4498-ad82-1de323aeed44 service nova] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Received unexpected event network-vif-plugged-a5b56921-0469-48f8-bbe7-b4106babb386 for instance with vm_state deleted and task_state None.
Apr 11 20:59:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:11 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246736.2575746, 097d9483-07ea-4dce-afd6-4d28dd0d2390 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:59:11 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] VM Stopped (Lifecycle Event)
Apr 11 20:59:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-17397f0f-8f45-4c6f-946f-8f0873ddf420 None None] [instance: 097d9483-07ea-4dce-afd6-4d28dd0d2390] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:59:12 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246737.7282217, 764a059b-9ded-4d53-b960-ced4abe4323d => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:59:12 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] VM Stopped (Lifecycle Event)
Apr 11 20:59:12 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e618912e-ce20-46f1-81d5-98aacaa951b4 None None] [instance: 764a059b-9ded-4d53-b960-ced4abe4323d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:59:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:59:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:20 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246745.7593944, 27573de4-b3dc-48ad-b1dc-11c3cb206670 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:59:20 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] VM Stopped (Lifecycle Event)
Apr 11 20:59:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5a545eeb-6966-46f6-bd31-a4791ebf88ad None None] [instance: 27573de4-b3dc-48ad-b1dc-11c3cb206670] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:59:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:26 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 20:59:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:29 user nova-compute[71654]: INFO nova.compute.manager [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Terminating instance
Apr 11 20:59:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-vif-unplugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] No waiting events found dispatching network-vif-unplugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG nova.compute.manager [req-f6605460-4663-4d1f-9c54-0a7c1c447157 req-2d7c1f05-0793-4c76-bbf5-35df0f9969e7 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-vif-unplugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:59:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:30 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Instance destroyed successfully.
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'resources' on Instance uuid b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-793939995',display_name='tempest-TestVolumeBootPattern-server-793939995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-793939995',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-5exo6wbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:57:55Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "address": "fa:16:3e:26:bf:46", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e785af1-7b", "ovs_interfaceid": "1e785af1-7b60-43ee-a29c-9a9f377d7784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_vif [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e785af1-7b, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:59:30 user nova-compute[71654]: INFO os_vif [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bf:46,bridge_name='br-int',has_traffic_filtering=True,id=1e785af1-7b60-43ee-a29c-9a9f377d7784,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e785af1-7b')
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UqEAdxgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 20:59:30 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d39998-c709-4621-bbd7-e2ab1cef41e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 20:59:30 user nova-compute[71654]: No targets found.
Apr 11 20:59:30 user nova-compute[71654]: iSNS:
Apr 11 20:59:30 user nova-compute[71654]: No targets found.
Apr 11 20:59:30 user nova-compute[71654]: STATIC:
Apr 11 20:59:30 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688
Apr 11 20:59:30 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 20:59:30 user nova-compute[71654]:                 Iface Name: default
Apr 11 20:59:30 user nova-compute[71654]: FIRMWARE:
Apr 11 20:59:30 user nova-compute[71654]: No targets found.
Apr 11 20:59:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 20:59:30 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 20:59:30 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef6518-a2c1-4459-aeb2-9a9872cfe4e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5b3c0e-b774-4840-b635-b8112f66999b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:59:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 (non-flash)
Apr 11 20:59:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb402df250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c417d-638d-4449-ac32-5b153cd9466b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7205544-b419-4185-a1e9-f4353a05e107]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[299177e9-41bc-45ff-bd4a-fc22ecbe88e1]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[741884a7-7841-4f79-a566-60a5f104a0cb]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO66128860-a6e9e7f2c66f4936', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_66128860', '/dev/disk/by-id/scsi-26136653965376632') {{(pid=81862) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456e6aa-bc5e-493f-9535-9579df95f66b]: (4, None) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf0611-2c31-487e-98bd-b0fc1c2a223a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3b833a-d1c3-4a7a-bdf3-bcbd9bf0bfa2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260]
Apr 11 20:59:30 user nova-compute[71654]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688, portal: 172.16.0.220,3260] successful.
Apr 11 20:59:30 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4630c311-564e-41c7-9c17-5a541be37688 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72a1b67-a3bf-442b-9b04-77b4a033f3e0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== disconnect_volume: return (309ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 20:59:30 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Deleting instance files /opt/stack/data/nova/instances/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d_del
Apr 11 20:59:30 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Deletion of /opt/stack/data/nova/instances/b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d_del complete
Apr 11 20:59:30 user nova-compute[71654]: INFO nova.compute.manager [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 11 20:59:30 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:59:30 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:59:31 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:31 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Took 0.44 seconds to deallocate network for instance.
Apr 11 20:59:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-vif-deleted-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:31 user nova-compute[71654]: INFO nova.compute.manager [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Neutron deleted interface 1e785af1-7b60-43ee-a29c-9a9f377d7784; detaching it from the instance and deleting it from the info cache
Apr 11 20:59:31 user nova-compute[71654]: DEBUG nova.network.neutron [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-b2669225-6892-4972-bb02-2f10f6f6f04b req-1a090724-56ae-4c00-9444-d8acc42fb2c0 service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Detach interface failed, port_id=1e785af1-7b60-43ee-a29c-9a9f377d7784, reason: Instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received event network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Acquiring lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] No waiting events found dispatching network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:32 user nova-compute[71654]: WARNING nova.compute.manager [req-288979e7-c4b8-430f-af1c-0d517e293c9d req-a11bef4d-0eca-4d03-a2bc-b180557e2cae service nova] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Received unexpected event network-vif-plugged-1e785af1-7b60-43ee-a29c-9a9f377d7784 for instance with vm_state active and task_state deleting.
Apr 11 20:59:32 user nova-compute[71654]: INFO nova.compute.manager [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Took 0.75 seconds to detach 1 volumes for instance.
Apr 11 20:59:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Deleting volume: 4630c311-564e-41c7-9c17-5a541be37688 {{(pid=71654) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:32 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Deleted allocations for instance b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e47f88ad-e846-433d-ba3a-c6e6a65e5175 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:35 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:35 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:35 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 20:59:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 20:59:37 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:59:37 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=26.30820083618164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 05f0405b-e73d-4c84-8208-21194ab434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 20:59:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 20:59:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 20:59:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 20:59:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:59:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 20:59:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:59:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 20:59:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:45 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246770.4164047, b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 20:59:45 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] VM Stopped (Lifecycle Event)
Apr 11 20:59:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-4cc74458-36dd-4f74-abc6-f9ce07c25b8b None None] [instance: b3a9d9f1-c2cd-4c3e-b537-51fd7b9d439d] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 20:59:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:46 user nova-compute[71654]: INFO nova.compute.manager [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Terminating instance
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-vif-unplugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] No waiting events found dispatching network-vif-unplugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-c61052e0-60a9-4145-960d-5b73cde647cd req-99d9eda4-b405-4056-87b3-0719b5463ca1 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-vif-unplugged-29039955-eab6-420c-aa2c-dbd6326814c4 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Instance destroyed successfully.
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lazy-loading 'resources' on Instance uuid f1d5f91c-afaa-456a-97e7-0460b1748d79 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-44480822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-44480822',id=13,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:40:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85bf8fe34838426ea05060463458e5e0',ramdisk_id='',reservation_id='r-3vvqecr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-243239500',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:42:07Z,user_data=None,user_id='1d5cb62cc3844248be2e4456d970ccdf',uuid=f1d5f91c-afaa-456a-97e7-0460b1748d79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converting VIF {"id": "29039955-eab6-420c-aa2c-dbd6326814c4", "address": "fa:16:3e:42:7e:1a", "network": {"id": "6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-820901597-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85bf8fe34838426ea05060463458e5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29039955-ea", "ovs_interfaceid": "29039955-eab6-420c-aa2c-dbd6326814c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG os_vif [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29039955-ea, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:46 user nova-compute[71654]: INFO os_vif [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:7e:1a,bridge_name='br-int',has_traffic_filtering=True,id=29039955-eab6-420c-aa2c-dbd6326814c4,network=Network(6bc1a3da-29b4-44a1-8c3a-0ec5e2fff761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29039955-ea')
Apr 11 20:59:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Deleting instance files /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79_del
Apr 11 20:59:46 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Deletion of /opt/stack/data/nova/instances/f1d5f91c-afaa-456a-97e7-0460b1748d79_del complete
Apr 11 20:59:46 user nova-compute[71654]: INFO nova.compute.manager [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 11 20:59:46 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:59:46 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-vif-deleted-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:47 user nova-compute[71654]: INFO nova.compute.manager [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Neutron deleted interface 29039955-eab6-420c-aa2c-dbd6326814c4; detaching it from the instance and deleting it from the info cache
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.network.neutron [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:47 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Took 0.50 seconds to deallocate network for instance.
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.compute.manager [req-f64c32dd-9a25-438c-9f30-49ad385087fb req-89a35902-85dd-494f-aa23-9ed91fca9c12 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Detach interface failed, port_id=29039955-eab6-420c-aa2c-dbd6326814c4, reason: Instance f1d5f91c-afaa-456a-97e7-0460b1748d79 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:47 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Deleted allocations for instance f1d5f91c-afaa-456a-97e7-0460b1748d79
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "05f0405b-e73d-4c84-8208-21194ab434d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:47 user nova-compute[71654]: INFO nova.compute.manager [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Terminating instance
Apr 11 20:59:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-af2385aa-f53f-42cc-883f-43c5d885dbb1 tempest-ServerBootFromVolumeStableRescueTest-243239500 tempest-ServerBootFromVolumeStableRescueTest-243239500-project-member] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.500s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Instance destroyed successfully.
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.objects.instance [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lazy-loading 'resources' on Instance uuid 05f0405b-e73d-4c84-8208-21194ab434d2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T20:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1539085704',display_name='tempest-ServerRescueNegativeTestJSON-server-1539085704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1539085704',id=17,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T20:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ad2f73c14141dd8f7aa0d6f6c747b0',ramdisk_id='',reservation_id='r-4f9q1axh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-777351805',owner_user_name='tempest-ServerRescueNegativeTestJSON-777351805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T20:49:38Z,user_data=None,user_id='dce0b6fa6d9546c8a04b7a4a5f93e0c7',uuid=05f0405b-e73d-4c84-8208-21194ab434d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converting VIF {"id": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "address": "fa:16:3e:f6:6b:1c", "network": {"id": "1ee91002-b796-478b-b740-f3297b37e1f0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-379643639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ad2f73c14141dd8f7aa0d6f6c747b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap730dc28f-1a", "ovs_interfaceid": "730dc28f-1a82-4d35-af86-4a5744bd7ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG os_vif [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap730dc28f-1a, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:59:48 user nova-compute[71654]: INFO os_vif [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6b:1c,bridge_name='br-int',has_traffic_filtering=True,id=730dc28f-1a82-4d35-af86-4a5744bd7ef0,network=Network(1ee91002-b796-478b-b740-f3297b37e1f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap730dc28f-1a')
Apr 11 20:59:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Deleting instance files /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2_del
Apr 11 20:59:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Deletion of /opt/stack/data/nova/instances/05f0405b-e73d-4c84-8208-21194ab434d2_del complete
Apr 11 20:59:48 user nova-compute[71654]: INFO nova.compute.manager [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received event network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Acquiring lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "f1d5f91c-afaa-456a-97e7-0460b1748d79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] No waiting events found dispatching network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:48 user nova-compute[71654]: WARNING nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Received unexpected event network-vif-plugged-29039955-eab6-420c-aa2c-dbd6326814c4 for instance with vm_state deleted and task_state None.
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-unplugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Acquiring lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] Lock "05f0405b-e73d-4c84-8208-21194ab434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] No waiting events found dispatching network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 20:59:48 user nova-compute[71654]: WARNING nova.compute.manager [req-f5d5f1ac-a791-4ef5-b721-4e3f1ef6f1c3 req-5d63115c-957e-469e-83a5-13519afbc360 service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received unexpected event network-vif-plugged-730dc28f-1a82-4d35-af86-4a5744bd7ef0 for instance with vm_state active and task_state deleting.
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 20:59:48 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Took 0.43 seconds to deallocate network for instance.
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 20:59:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:48 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Deleted allocations for instance 05f0405b-e73d-4c84-8208-21194ab434d2
Apr 11 20:59:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b6caf96c-cc60-46a7-9cf3-d64edf9a3b36 tempest-ServerRescueNegativeTestJSON-777351805 tempest-ServerRescueNegativeTestJSON-777351805-project-member] Lock "05f0405b-e73d-4c84-8208-21194ab434d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.437s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 20:59:49 user nova-compute[71654]: DEBUG nova.compute.manager [req-22cd9716-aaf1-421e-9634-98fe27e825dd req-06c06c12-04a2-41d4-b666-11ea2dd6553b service nova] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Received event network-vif-deleted-730dc28f-1a82-4d35-af86-4a5744bd7ef0 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 20:59:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 20:59:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 20:59:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:01 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246786.7133386, f1d5f91c-afaa-456a-97e7-0460b1748d79 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:01 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] VM Stopped (Lifecycle Event)
Apr 11 21:00:01 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd1c72d-bea4-4029-93ff-15181855acc3 None None] [instance: f1d5f91c-afaa-456a-97e7-0460b1748d79] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:03 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246788.1567612, 05f0405b-e73d-4c84-8208-21194ab434d2 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:03 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] VM Stopped (Lifecycle Event)
Apr 11 21:00:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7da901b5-f843-44c6-bbbe-e9e458b2f60c None None] [instance: 05f0405b-e73d-4c84-8208-21194ab434d2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:00:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:00:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:00:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:19 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:00:19 user nova-compute[71654]: INFO nova.compute.claims [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Claim successful on node user
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:00:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.policy [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c721a6b00fdd479eaf8634f51e4a1b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0794c4a442430b8fc1faf0bd1ee1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:00:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Creating image(s)
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "/opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "/opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "/opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk 1073741824" returned: 0 in 0.050s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Successfully created port: 62239930-fb45-440e-8376-081e29157258 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:20 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Cannot resize image /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lazy-loading 'migration_context' on Instance uuid e13e0c74-2071-482a-a2e9-03ea7182b9f0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Ensure instance console log exists: /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Successfully updated port: 62239930-fb45-440e-8376-081e29157258 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquired lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-changed-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Refreshing instance network info cache due to event network-changed-62239930-fb45-440e-8376-081e29157258. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Acquiring lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updating instance_info_cache with network_info: [{"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Releasing lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Instance network_info: |[{"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Acquired lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Refreshing network info cache for port 62239930-fb45-440e-8376-081e29157258 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Start _get_guest_xml network_info=[{"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:00:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1807635275',display_name='tempest-VolumesActionsTest-instance-1807635275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1807635275',id=34,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b0794c4a442430b8fc1faf0bd1ee1ca',ramdisk_id='',reservation_id='r-dxafooyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-474021325',owner_user_name='tempest-VolumesActionsTest-474021325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:00:20Z,user_data=None,user_id='c721a6b00fdd479eaf8634f51e4a1b13',uuid=e13e0c74-2071-482a-a2e9-03ea7182b9f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Converting VIF {"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lazy-loading 'pci_devices' on Instance uuid e13e0c74-2071-482a-a2e9-03ea7182b9f0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:00:22 user nova-compute[71654]:   <uuid>e13e0c74-2071-482a-a2e9-03ea7182b9f0</uuid>
Apr 11 21:00:22 user nova-compute[71654]:   <name>instance-00000022</name>
Apr 11 21:00:22 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:00:22 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:00:22 user nova-compute[71654]:   <metadata>
Apr 11 21:00:22 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:00:22 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:00:22 user nova-compute[71654]:       <nova:name>tempest-VolumesActionsTest-instance-1807635275</nova:name>
Apr 11 21:00:22 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:00:22</nova:creationTime>
Apr 11 21:00:22 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:00:22 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:00:22 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:00:22 user nova-compute[71654]:       <nova:owner>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:user uuid="c721a6b00fdd479eaf8634f51e4a1b13">tempest-VolumesActionsTest-474021325-project-member</nova:user>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:project uuid="9b0794c4a442430b8fc1faf0bd1ee1ca">tempest-VolumesActionsTest-474021325</nova:project>
Apr 11 21:00:22 user nova-compute[71654]:       </nova:owner>
Apr 11 21:00:22 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:00:22 user nova-compute[71654]:       <nova:ports>
Apr 11 21:00:22 user nova-compute[71654]:         <nova:port uuid="62239930-fb45-440e-8376-081e29157258">
Apr 11 21:00:22 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:00:22 user nova-compute[71654]:         </nova:port>
Apr 11 21:00:22 user nova-compute[71654]:       </nova:ports>
Apr 11 21:00:22 user nova-compute[71654]:     </nova:instance>
Apr 11 21:00:22 user nova-compute[71654]:   </metadata>
Apr 11 21:00:22 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:00:22 user nova-compute[71654]:     <system>
Apr 11 21:00:22 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:00:22 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:00:22 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:00:22 user nova-compute[71654]:       <entry name="serial">e13e0c74-2071-482a-a2e9-03ea7182b9f0</entry>
Apr 11 21:00:22 user nova-compute[71654]:       <entry name="uuid">e13e0c74-2071-482a-a2e9-03ea7182b9f0</entry>
Apr 11 21:00:22 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:00:22 user nova-compute[71654]:     </system>
Apr 11 21:00:22 user nova-compute[71654]:   </sysinfo>
Apr 11 21:00:22 user nova-compute[71654]:   <os>
Apr 11 21:00:22 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:00:22 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:00:22 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:00:22 user nova-compute[71654]:   </os>
Apr 11 21:00:22 user nova-compute[71654]:   <features>
Apr 11 21:00:22 user nova-compute[71654]:     <acpi/>
Apr 11 21:00:22 user nova-compute[71654]:     <apic/>
Apr 11 21:00:22 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:00:22 user nova-compute[71654]:   </features>
Apr 11 21:00:22 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:00:22 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:00:22 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:00:22 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:00:22 user nova-compute[71654]:   </clock>
Apr 11 21:00:22 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:00:22 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:00:22 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:00:22 user nova-compute[71654]:   </cpu>
Apr 11 21:00:22 user nova-compute[71654]:   <devices>
Apr 11 21:00:22 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:00:22 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:00:22 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk"/>
Apr 11 21:00:22 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:00:22 user nova-compute[71654]:     </disk>
Apr 11 21:00:22 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:00:22 user nova-compute[71654]:       <mac address="fa:16:3e:42:bd:2f"/>
Apr 11 21:00:22 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:00:22 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:00:22 user nova-compute[71654]:       <target dev="tap62239930-fb"/>
Apr 11 21:00:22 user nova-compute[71654]:     </interface>
Apr 11 21:00:22 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:00:22 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/console.log" append="off"/>
Apr 11 21:00:22 user nova-compute[71654]:     </serial>
Apr 11 21:00:22 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:00:22 user nova-compute[71654]:     <video>
Apr 11 21:00:22 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:00:22 user nova-compute[71654]:     </video>
Apr 11 21:00:22 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:00:22 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:00:22 user nova-compute[71654]:     </rng>
Apr 11 21:00:22 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:00:22 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:00:22 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:00:22 user nova-compute[71654]:     </memballoon>
Apr 11 21:00:22 user nova-compute[71654]:   </devices>
Apr 11 21:00:22 user nova-compute[71654]: </domain>
Apr 11 21:00:22 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1807635275',display_name='tempest-VolumesActionsTest-instance-1807635275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1807635275',id=34,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b0794c4a442430b8fc1faf0bd1ee1ca',ramdisk_id='',reservation_id='r-dxafooyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-474021325',owner_user_name='tempest-VolumesActionsTest-474021325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:00:20Z,user_data=None,user_id='c721a6b00fdd479eaf8634f51e4a1b13',uuid=e13e0c74-2071-482a-a2e9-03ea7182b9f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Converting VIF {"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG os_vif [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62239930-fb, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62239930-fb, col_values=(('external_ids', {'iface-id': '62239930-fb45-440e-8376-081e29157258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:bd:2f', 'vm-uuid': 'e13e0c74-2071-482a-a2e9-03ea7182b9f0'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:22 user nova-compute[71654]: INFO os_vif [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb')
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] No VIF found with MAC fa:16:3e:42:bd:2f, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updated VIF entry in instance network info cache for port 62239930-fb45-440e-8376-081e29157258. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updating instance_info_cache with network_info: [{"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fc6f0b53-e09c-4c63-a48f-c20111ab004d req-f89ed241-c1f3-43fd-abaa-a234bb89e2a0 service nova] Releasing lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-vif-plugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] No waiting events found dispatching network-vif-plugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:00:24 user nova-compute[71654]: WARNING nova.compute.manager [req-92212a79-880f-4f85-a1b6-8384a64ef0e2 req-c7f53698-4d7a-4a0b-9c6b-c7c2f4cfdc27 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received unexpected event network-vif-plugged-62239930-fb45-440e-8376-081e29157258 for instance with vm_state building and task_state spawning.
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246825.8186505, e13e0c74-2071-482a-a2e9-03ea7182b9f0 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:25 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] VM Resumed (Lifecycle Event)
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:00:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Instance spawned successfully.
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:25 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246825.8198743, e13e0c74-2071-482a-a2e9-03ea7182b9f0 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:25 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] VM Started (Lifecycle Event)
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:00:25 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:00:25 user nova-compute[71654]: INFO nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 11 21:00:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:26 user nova-compute[71654]: INFO nova.compute.manager [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Took 6.08 seconds to build instance.
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7ea1c320-6740-4b38-b930-c74faf731923 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.176s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-vif-plugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] No waiting events found dispatching network-vif-plugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:00:26 user nova-compute[71654]: WARNING nova.compute.manager [req-25b7b388-cb8f-4752-8500-06605eba6ade req-cfa120dd-ac38-4646-a8a9-00ec53414106 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received unexpected event network-vif-plugged-62239930-fb45-440e-8376-081e29157258 for instance with vm_state active and task_state None.
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:00:26 user nova-compute[71654]: INFO nova.compute.claims [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Claim successful on node user
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:00:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:00:26 user nova-compute[71654]: INFO nova.virt.block_device [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Booting with volume ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd at /dev/vda
Apr 11 21:00:26 user nova-compute[71654]: DEBUG os_brick.utils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.policy [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1605f29a-f6b7-497a-a1c5-85f41416b199]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14cd6f-e27d-4ad8-89ea-f9cdee83a87a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cef25b-ae67-4346-b0b2-c86404bed56e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1a9b2-15dc-4726-b3e4-20443b8948fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:00:26 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:00:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85c369-bbf9-4f6d-96eb-bfaeef14b3f7]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG os_brick.utils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:00:26 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating existing volume attachment record: 2c0ea826-9967-4fbc-b3a9-2dfafee5e89b {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:00:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:27 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Successfully created port: 4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Successfully updated port: 4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquired lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-changed-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Refreshing instance network info cache due to event network-changed-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Acquiring lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating instance_info_cache with network_info: [{"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Releasing lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Instance network_info: |[{"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Acquired lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.network.neutron [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Refreshing network info cache for port 4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:00:29 user nova-compute[71654]: DEBUG nova.network.neutron [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updated VIF entry in instance network info cache for port 4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:00:29 user nova-compute[71654]: DEBUG nova.network.neutron [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating instance_info_cache with network_info: [{"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-61927744-d013-425d-89c8-e3f4803263c3 req-4e3eafa3-c244-4724-8755-865a41914178 service nova] Releasing lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:00:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Creating image(s)
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Ensure instance console log exists: /opt/stack/data/nova/instances/d6eb5a48-11e6-4d15-a10e-41a3067944a2/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Start _get_guest_xml network_info=[{"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXwFvmEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6eb5a48-11e6-4d15-a10e-41a3067944a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd', 'serial': 'ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '2c0ea826-9967-4fbc-b3a9-2dfafee5e89b', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:00:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXwFvmEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:00:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:00:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:00:31 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c606b0-1125-419e-acf3-dae218e6c969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:00:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eb8326-865b-4533-8cc6-a800d61dfe46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd] added
Apr 11 21:00:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97e7ab-0f9c-4b9f-a21f-7b4a8f065ece]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7156ea2-ab98-4885-ae0b-bf052b4a8d86]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXwFvmEZ {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXwFvmEZ" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f38a7c-b333-455c-b966-b22a9e35d740]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXwFvmEZ'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6e8279-8c5f-4189-9d71-638533f7e118]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[becca691-a206-404d-b28c-b88f2bfd033b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:00:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:00:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:00:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:00:31 user nova-compute[71654]: 
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e6a962-70cb-481d-bbd1-55a416fded1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260]
Apr 11 21:00:31 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260] successful.
Apr 11 21:00:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f26e43-091d-4753-ab30-8d75ff24b32a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b009be68-6007-4dd2-b389-1cce3dcf05db]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:00:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:00:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[079288d2-acc3-41ba-bdc1-7fe2d37cffe4]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:00:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXwFvmEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23538376566346461', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538376566346461', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-222867129',display_name='tempest-TestVolumeBootPattern-volume-backed-server-222867129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-222867129',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-782kz0ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:00:27Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=d6eb5a48-11e6-4d15-a10e-41a3067944a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'pci_devices' on Instance uuid d6eb5a48-11e6-4d15-a10e-41a3067944a2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:00:32 user nova-compute[71654]:   <uuid>d6eb5a48-11e6-4d15-a10e-41a3067944a2</uuid>
Apr 11 21:00:32 user nova-compute[71654]:   <name>instance-00000023</name>
Apr 11 21:00:32 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:00:32 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:00:32 user nova-compute[71654]:   <metadata>
Apr 11 21:00:32 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:00:32 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:00:32 user nova-compute[71654]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-222867129</nova:name>
Apr 11 21:00:32 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:00:31</nova:creationTime>
Apr 11 21:00:32 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:00:32 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:00:32 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:00:32 user nova-compute[71654]:       <nova:owner>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:user uuid="3e34c9542bd64328a3c8d5cdb7421917">tempest-TestVolumeBootPattern-221737316-project-member</nova:user>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:project uuid="2c36c3a15f2a413e81544f65c4f6ede4">tempest-TestVolumeBootPattern-221737316</nova:project>
Apr 11 21:00:32 user nova-compute[71654]:       </nova:owner>
Apr 11 21:00:32 user nova-compute[71654]:       <nova:ports>
Apr 11 21:00:32 user nova-compute[71654]:         <nova:port uuid="4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a">
Apr 11 21:00:32 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:00:32 user nova-compute[71654]:         </nova:port>
Apr 11 21:00:32 user nova-compute[71654]:       </nova:ports>
Apr 11 21:00:32 user nova-compute[71654]:     </nova:instance>
Apr 11 21:00:32 user nova-compute[71654]:   </metadata>
Apr 11 21:00:32 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:00:32 user nova-compute[71654]:     <system>
Apr 11 21:00:32 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:00:32 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:00:32 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:00:32 user nova-compute[71654]:       <entry name="serial">d6eb5a48-11e6-4d15-a10e-41a3067944a2</entry>
Apr 11 21:00:32 user nova-compute[71654]:       <entry name="uuid">d6eb5a48-11e6-4d15-a10e-41a3067944a2</entry>
Apr 11 21:00:32 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:00:32 user nova-compute[71654]:     </system>
Apr 11 21:00:32 user nova-compute[71654]:   </sysinfo>
Apr 11 21:00:32 user nova-compute[71654]:   <os>
Apr 11 21:00:32 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:00:32 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:00:32 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:00:32 user nova-compute[71654]:   </os>
Apr 11 21:00:32 user nova-compute[71654]:   <features>
Apr 11 21:00:32 user nova-compute[71654]:     <acpi/>
Apr 11 21:00:32 user nova-compute[71654]:     <apic/>
Apr 11 21:00:32 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:00:32 user nova-compute[71654]:   </features>
Apr 11 21:00:32 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:00:32 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:00:32 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:00:32 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:00:32 user nova-compute[71654]:   </clock>
Apr 11 21:00:32 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:00:32 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:00:32 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:00:32 user nova-compute[71654]:   </cpu>
Apr 11 21:00:32 user nova-compute[71654]:   <devices>
Apr 11 21:00:32 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 21:00:32 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:00:32 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 21:00:32 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:00:32 user nova-compute[71654]:       <serial>ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd</serial>
Apr 11 21:00:32 user nova-compute[71654]:     </disk>
Apr 11 21:00:32 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:00:32 user nova-compute[71654]:       <mac address="fa:16:3e:b2:1b:0e"/>
Apr 11 21:00:32 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:00:32 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:00:32 user nova-compute[71654]:       <target dev="tap4a6e2e51-c6"/>
Apr 11 21:00:32 user nova-compute[71654]:     </interface>
Apr 11 21:00:32 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:00:32 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/d6eb5a48-11e6-4d15-a10e-41a3067944a2/console.log" append="off"/>
Apr 11 21:00:32 user nova-compute[71654]:     </serial>
Apr 11 21:00:32 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:00:32 user nova-compute[71654]:     <video>
Apr 11 21:00:32 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:00:32 user nova-compute[71654]:     </video>
Apr 11 21:00:32 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:00:32 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:00:32 user nova-compute[71654]:     </rng>
Apr 11 21:00:32 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:00:32 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:00:32 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:00:32 user nova-compute[71654]:     </memballoon>
Apr 11 21:00:32 user nova-compute[71654]:   </devices>
Apr 11 21:00:32 user nova-compute[71654]: </domain>
Apr 11 21:00:32 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-222867129',display_name='tempest-TestVolumeBootPattern-volume-backed-server-222867129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-222867129',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-782kz0ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:00:27Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=d6eb5a48-11e6-4d15-a10e-41a3067944a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG os_vif [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a6e2e51-c6, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a6e2e51-c6, col_values=(('external_ids', {'iface-id': '4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:1b:0e', 'vm-uuid': 'd6eb5a48-11e6-4d15-a10e-41a3067944a2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:32 user nova-compute[71654]: INFO os_vif [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6')
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No VIF found with MAC fa:16:3e:b2:1b:0e, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:00:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] No waiting events found dispatching network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:00:34 user nova-compute[71654]: WARNING nova.compute.manager [req-e14444ac-aa3d-4ca5-9fb0-d5165a640dd7 req-28158857-b05d-4fd5-ad74-8cf75b3e644e service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received unexpected event network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance with vm_state building and task_state spawning.
Apr 11 21:00:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:35 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246836.2011464, d6eb5a48-11e6-4d15-a10e-41a3067944a2 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] VM Resumed (Lifecycle Event)
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Instance spawned successfully.
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246836.202551, d6eb5a48-11e6-4d15-a10e-41a3067944a2 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] VM Started (Lifecycle Event)
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Took 4.86 seconds to spawn the instance on the hypervisor.
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] No waiting events found dispatching network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:00:36 user nova-compute[71654]: WARNING nova.compute.manager [req-6b38940d-1508-4619-862a-1243239e4eeb req-f6239b9c-b35f-448a-a044-335480328696 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received unexpected event network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance with vm_state building and task_state spawning.
Apr 11 21:00:36 user nova-compute[71654]: INFO nova.compute.manager [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Took 9.99 seconds to build instance.
Apr 11 21:00:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6ba4af04-dbf7-46c0-838b-e36f1b94ab9f tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.086s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:00:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid e13e0c74-2071-482a-a2e9-03ea7182b9f0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updating instance_info_cache with network_info: [{"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-e13e0c74-2071-482a-a2e9-03ea7182b9f0" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:00:38 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:38 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=26.396636962890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:00:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:00:39 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:00:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:00:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:00:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:00:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:00:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:50 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:00:50 user nova-compute[71654]: INFO nova.compute.claims [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Claim successful on node user
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:00:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.policy [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:00:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Creating image(s)
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "/opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "/opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk 1073741824" returned: 0 in 0.222s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Cannot resize image /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.objects.instance [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lazy-loading 'migration_context' on Instance uuid 5a0171d4-fddd-424b-9b11-9f78723f3c1b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Ensure instance console log exists: /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Successfully created port: 3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Successfully updated port: 3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquired lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-changed-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Refreshing instance network info cache due to event network-changed-3a08d9a8-9b94-4131-b609-11988264e1a8. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:00:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Acquiring lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.neutron [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Releasing lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Instance network_info: |[{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Acquired lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Refreshing network info cache for port 3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Start _get_guest_xml network_info=[{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:00:53 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:53 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-857833810',display_name='tempest-ServersNegativeTestJSON-server-857833810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-857833810',id=36,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf42a499ff3c43afaea1b716c0e801ac',ramdisk_id='',reservation_id='r-bulfj4qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1791140415',owner_user_name='tempest-ServersNegativeTestJSON-1791140415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:00:51Z,user_data=None,user_id='8557484fdf27419384420c986b776a90',uuid=5a0171d4-fddd-424b-9b11-9f78723f3c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converting VIF {"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a0171d4-fddd-424b-9b11-9f78723f3c1b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:00:53 user nova-compute[71654]:   <uuid>5a0171d4-fddd-424b-9b11-9f78723f3c1b</uuid>
Apr 11 21:00:53 user nova-compute[71654]:   <name>instance-00000024</name>
Apr 11 21:00:53 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:00:53 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:00:53 user nova-compute[71654]:   <metadata>
Apr 11 21:00:53 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:00:53 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:00:53 user nova-compute[71654]:       <nova:name>tempest-ServersNegativeTestJSON-server-857833810</nova:name>
Apr 11 21:00:53 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:00:53</nova:creationTime>
Apr 11 21:00:53 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:00:53 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:00:53 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:00:53 user nova-compute[71654]:       <nova:owner>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:user uuid="8557484fdf27419384420c986b776a90">tempest-ServersNegativeTestJSON-1791140415-project-member</nova:user>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:project uuid="cf42a499ff3c43afaea1b716c0e801ac">tempest-ServersNegativeTestJSON-1791140415</nova:project>
Apr 11 21:00:53 user nova-compute[71654]:       </nova:owner>
Apr 11 21:00:53 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:00:53 user nova-compute[71654]:       <nova:ports>
Apr 11 21:00:53 user nova-compute[71654]:         <nova:port uuid="3a08d9a8-9b94-4131-b609-11988264e1a8">
Apr 11 21:00:53 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:00:53 user nova-compute[71654]:         </nova:port>
Apr 11 21:00:53 user nova-compute[71654]:       </nova:ports>
Apr 11 21:00:53 user nova-compute[71654]:     </nova:instance>
Apr 11 21:00:53 user nova-compute[71654]:   </metadata>
Apr 11 21:00:53 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:00:53 user nova-compute[71654]:     <system>
Apr 11 21:00:53 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:00:53 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:00:53 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:00:53 user nova-compute[71654]:       <entry name="serial">5a0171d4-fddd-424b-9b11-9f78723f3c1b</entry>
Apr 11 21:00:53 user nova-compute[71654]:       <entry name="uuid">5a0171d4-fddd-424b-9b11-9f78723f3c1b</entry>
Apr 11 21:00:53 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:00:53 user nova-compute[71654]:     </system>
Apr 11 21:00:53 user nova-compute[71654]:   </sysinfo>
Apr 11 21:00:53 user nova-compute[71654]:   <os>
Apr 11 21:00:53 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:00:53 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:00:53 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:00:53 user nova-compute[71654]:   </os>
Apr 11 21:00:53 user nova-compute[71654]:   <features>
Apr 11 21:00:53 user nova-compute[71654]:     <acpi/>
Apr 11 21:00:53 user nova-compute[71654]:     <apic/>
Apr 11 21:00:53 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:00:53 user nova-compute[71654]:   </features>
Apr 11 21:00:53 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:00:53 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:00:53 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:00:53 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:00:53 user nova-compute[71654]:   </clock>
Apr 11 21:00:53 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:00:53 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:00:53 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:00:53 user nova-compute[71654]:   </cpu>
Apr 11 21:00:53 user nova-compute[71654]:   <devices>
Apr 11 21:00:53 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:00:53 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:00:53 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk"/>
Apr 11 21:00:53 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:00:53 user nova-compute[71654]:     </disk>
Apr 11 21:00:53 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:00:53 user nova-compute[71654]:       <mac address="fa:16:3e:d1:a3:ce"/>
Apr 11 21:00:53 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:00:53 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:00:53 user nova-compute[71654]:       <target dev="tap3a08d9a8-9b"/>
Apr 11 21:00:53 user nova-compute[71654]:     </interface>
Apr 11 21:00:53 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:00:53 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/console.log" append="off"/>
Apr 11 21:00:53 user nova-compute[71654]:     </serial>
Apr 11 21:00:53 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:00:53 user nova-compute[71654]:     <video>
Apr 11 21:00:53 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:00:53 user nova-compute[71654]:     </video>
Apr 11 21:00:53 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:00:53 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:00:53 user nova-compute[71654]:     </rng>
Apr 11 21:00:53 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:00:53 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:00:53 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:00:53 user nova-compute[71654]:     </memballoon>
Apr 11 21:00:53 user nova-compute[71654]:   </devices>
Apr 11 21:00:53 user nova-compute[71654]: </domain>
Apr 11 21:00:53 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-857833810',display_name='tempest-ServersNegativeTestJSON-server-857833810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-857833810',id=36,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf42a499ff3c43afaea1b716c0e801ac',ramdisk_id='',reservation_id='r-bulfj4qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1791140415',owner_user_name='tempest-ServersNegativeTestJSON-1791140415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:00:51Z,user_data=None,user_id='8557484fdf27419384420c986b776a90',uuid=5a0171d4-fddd-424b-9b11-9f78723f3c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converting VIF {"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG os_vif [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a08d9a8-9b, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a08d9a8-9b, col_values=(('external_ids', {'iface-id': '3a08d9a8-9b94-4131-b609-11988264e1a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:a3:ce', 'vm-uuid': '5a0171d4-fddd-424b-9b11-9f78723f3c1b'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:53 user nova-compute[71654]: INFO os_vif [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b')
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] No VIF found with MAC fa:16:3e:d1:a3:ce, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updated VIF entry in instance network info cache for port 3a08d9a8-9b94-4131-b609-11988264e1a8. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG nova.network.neutron [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:00:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69e82526-a206-40ed-b011-dc2d3062a20e req-f74debba-9412-4957-8484-cfa7de8cc9a5 service nova] Releasing lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:00:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] No waiting events found dispatching network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:00:55 user nova-compute[71654]: WARNING nova.compute.manager [req-19c11d10-69ad-4cb8-b53b-f393b26dd073 req-ddb41f99-b191-4641-8463-fcc473836970 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received unexpected event network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 for instance with vm_state building and task_state spawning.
Apr 11 21:00:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246856.939076, 5a0171d4-fddd-424b-9b11-9f78723f3c1b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] VM Resumed (Lifecycle Event)
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:00:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Instance spawned successfully.
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:00:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:00:56 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246856.9412344, 5a0171d4-fddd-424b-9b11-9f78723f3c1b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:00:56 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] VM Started (Lifecycle Event)
Apr 11 21:00:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:00:57 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:00:57 user nova-compute[71654]: INFO nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 11 21:00:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:00:57 user nova-compute[71654]: INFO nova.compute.manager [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Took 6.24 seconds to build instance.
Apr 11 21:00:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:00:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:00:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:00:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] No waiting events found dispatching network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:00:57 user nova-compute[71654]: WARNING nova.compute.manager [req-d0f93c5c-082e-4d9f-adff-f6a1f80c8296 req-f211127b-c444-45b7-a55c-6847e3d4a227 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received unexpected event network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 for instance with vm_state active and task_state None.
Apr 11 21:00:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-885de065-57bf-4c50-814d-f594c1b3970a tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.329s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:00:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:00:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:01:05 user nova-compute[71654]: INFO nova.compute.claims [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Claim successful on node user
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:01:05 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:01:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:01:06 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Creating image(s)
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "/opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "/opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "/opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.policy [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57f22d3582bd4d2da3b18d2d0b68c29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90afd2eb3cec40029264c2f35b2546a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk 1073741824" returned: 0 in 0.052s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Cannot resize image /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.objects.instance [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lazy-loading 'migration_context' on Instance uuid 1de6fbc5-8846-4975-9ee4-3b554e1fd667 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Ensure instance console log exists: /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:06 user nova-compute[71654]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Successfully created port: eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Successfully updated port: eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "refresh_cache-1de6fbc5-8846-4975-9ee4-3b554e1fd667" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquired lock "refresh_cache-1de6fbc5-8846-4975-9ee4-3b554e1fd667" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-changed-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG nova.compute.manager [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Refreshing instance network info cache due to event network-changed-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Acquiring lock "refresh_cache-1de6fbc5-8846-4975-9ee4-3b554e1fd667" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:01:07 user nova-compute[71654]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.neutron [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Updating instance_info_cache with network_info: [{"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Releasing lock "refresh_cache-1de6fbc5-8846-4975-9ee4-3b554e1fd667" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Instance network_info: |[{"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Acquired lock "refresh_cache-1de6fbc5-8846-4975-9ee4-3b554e1fd667" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.neutron [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Refreshing network info cache for port eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Start _get_guest_xml network_info=[{"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:01:08 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:01:08 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2046167664',display_name='tempest-VolumesNegativeTest-instance-2046167664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2046167664',id=37,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90afd2eb3cec40029264c2f35b2546a3',ramdisk_id='',reservation_id='r-vbfmmgvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1031545147',owner_user_name='tempest-VolumesNegativeTest-1031545147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:01:06Z,user_data=None,user_id='57f22d3582bd4d2da3b18d2d0b68c29b',uuid=1de6fbc5-8846-4975-9ee4-3b554e1fd667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Converting VIF {"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.objects.instance [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lazy-loading 'pci_devices' on Instance uuid 1de6fbc5-8846-4975-9ee4-3b554e1fd667 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:01:08 user nova-compute[71654]:   <uuid>1de6fbc5-8846-4975-9ee4-3b554e1fd667</uuid>
Apr 11 21:01:08 user nova-compute[71654]:   <name>instance-00000025</name>
Apr 11 21:01:08 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:01:08 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:01:08 user nova-compute[71654]:   <metadata>
Apr 11 21:01:08 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:01:08 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:01:08 user nova-compute[71654]:       <nova:name>tempest-VolumesNegativeTest-instance-2046167664</nova:name>
Apr 11 21:01:08 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:01:08</nova:creationTime>
Apr 11 21:01:08 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:01:08 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:01:08 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:01:08 user nova-compute[71654]:       <nova:owner>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:user uuid="57f22d3582bd4d2da3b18d2d0b68c29b">tempest-VolumesNegativeTest-1031545147-project-member</nova:user>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:project uuid="90afd2eb3cec40029264c2f35b2546a3">tempest-VolumesNegativeTest-1031545147</nova:project>
Apr 11 21:01:08 user nova-compute[71654]:       </nova:owner>
Apr 11 21:01:08 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:01:08 user nova-compute[71654]:       <nova:ports>
Apr 11 21:01:08 user nova-compute[71654]:         <nova:port uuid="eed7c111-5c02-4a4e-b9eb-27ee25efc7dc">
Apr 11 21:01:08 user nova-compute[71654]:           <nova:ip type="fixed" address="192.168.233.33" ipVersion="4"/>
Apr 11 21:01:08 user nova-compute[71654]:         </nova:port>
Apr 11 21:01:08 user nova-compute[71654]:       </nova:ports>
Apr 11 21:01:08 user nova-compute[71654]:     </nova:instance>
Apr 11 21:01:08 user nova-compute[71654]:   </metadata>
Apr 11 21:01:08 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:01:08 user nova-compute[71654]:     <system>
Apr 11 21:01:08 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:01:08 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:01:08 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:01:08 user nova-compute[71654]:       <entry name="serial">1de6fbc5-8846-4975-9ee4-3b554e1fd667</entry>
Apr 11 21:01:08 user nova-compute[71654]:       <entry name="uuid">1de6fbc5-8846-4975-9ee4-3b554e1fd667</entry>
Apr 11 21:01:08 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:01:08 user nova-compute[71654]:     </system>
Apr 11 21:01:08 user nova-compute[71654]:   </sysinfo>
Apr 11 21:01:08 user nova-compute[71654]:   <os>
Apr 11 21:01:08 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:01:08 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:01:08 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:01:08 user nova-compute[71654]:   </os>
Apr 11 21:01:08 user nova-compute[71654]:   <features>
Apr 11 21:01:08 user nova-compute[71654]:     <acpi/>
Apr 11 21:01:08 user nova-compute[71654]:     <apic/>
Apr 11 21:01:08 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:01:08 user nova-compute[71654]:   </features>
Apr 11 21:01:08 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:01:08 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:01:08 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:01:08 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:01:08 user nova-compute[71654]:   </clock>
Apr 11 21:01:08 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:01:08 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:01:08 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:01:08 user nova-compute[71654]:   </cpu>
Apr 11 21:01:08 user nova-compute[71654]:   <devices>
Apr 11 21:01:08 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:01:08 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:01:08 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk"/>
Apr 11 21:01:08 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:01:08 user nova-compute[71654]:     </disk>
Apr 11 21:01:08 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:01:08 user nova-compute[71654]:       <mac address="fa:16:3e:c9:1c:7b"/>
Apr 11 21:01:08 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:01:08 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:01:08 user nova-compute[71654]:       <target dev="tapeed7c111-5c"/>
Apr 11 21:01:08 user nova-compute[71654]:     </interface>
Apr 11 21:01:08 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:01:08 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/console.log" append="off"/>
Apr 11 21:01:08 user nova-compute[71654]:     </serial>
Apr 11 21:01:08 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:01:08 user nova-compute[71654]:     <video>
Apr 11 21:01:08 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:01:08 user nova-compute[71654]:     </video>
Apr 11 21:01:08 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:01:08 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:01:08 user nova-compute[71654]:     </rng>
Apr 11 21:01:08 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:01:08 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:01:08 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:01:08 user nova-compute[71654]:     </memballoon>
Apr 11 21:01:08 user nova-compute[71654]:   </devices>
Apr 11 21:01:08 user nova-compute[71654]: </domain>
Apr 11 21:01:08 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2046167664',display_name='tempest-VolumesNegativeTest-instance-2046167664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2046167664',id=37,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90afd2eb3cec40029264c2f35b2546a3',ramdisk_id='',reservation_id='r-vbfmmgvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1031545147',owner_user_name='tempest-VolumesNegativeTest-1031545147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:01:06Z,user_data=None,user_id='57f22d3582bd4d2da3b18d2d0b68c29b',uuid=1de6fbc5-8846-4975-9ee4-3b554e1fd667,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Converting VIF {"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG os_vif [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeed7c111-5c, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeed7c111-5c, col_values=(('external_ids', {'iface-id': 'eed7c111-5c02-4a4e-b9eb-27ee25efc7dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:1c:7b', 'vm-uuid': '1de6fbc5-8846-4975-9ee4-3b554e1fd667'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:08 user nova-compute[71654]: INFO os_vif [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c')
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] No VIF found with MAC fa:16:3e:c9:1c:7b, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.neutron [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Updated VIF entry in instance network info cache for port eed7c111-5c02-4a4e-b9eb-27ee25efc7dc. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG nova.network.neutron [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Updating instance_info_cache with network_info: [{"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:01:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a36379cd-2ecf-4ec0-96b4-752a1dd03d9d req-625bda41-81c2-40c6-a605-bbf4277ad37a service nova] Releasing lock "refresh_cache-1de6fbc5-8846-4975-9ee4-3b554e1fd667" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:01:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] No waiting events found dispatching network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:01:10 user nova-compute[71654]: WARNING nova.compute.manager [req-e2a214c7-df77-41bc-b702-8ee71c1f3bc2 req-5e7cd43f-3f55-489a-b966-bd1c2da47591 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received unexpected event network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance with vm_state building and task_state spawning.
Apr 11 21:01:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246871.8328068, 1de6fbc5-8846-4975-9ee4-3b554e1fd667 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:01:11 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] VM Resumed (Lifecycle Event)
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:01:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Instance spawned successfully.
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:01:11 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246871.8351727, 1de6fbc5-8846-4975-9ee4-3b554e1fd667 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:01:11 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] VM Started (Lifecycle Event)
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:01:11 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:01:11 user nova-compute[71654]: INFO nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 11 21:01:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:01:12 user nova-compute[71654]: INFO nova.compute.manager [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Took 6.45 seconds to build instance.
Apr 11 21:01:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bceb3dfc-3260-4a02-a574-012d6b1f11e9 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.550s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:01:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] No waiting events found dispatching network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:01:12 user nova-compute[71654]: WARNING nova.compute.manager [req-a8dbee80-ecf2-4e04-880a-016dd645a98d req-f436728c-b938-4312-852c-2505e3fd9dae service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received unexpected event network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance with vm_state active and task_state None.
Apr 11 21:01:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:18 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:27 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:01:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:36 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating instance_info_cache with network_info: [{"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:37 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:01:38 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:01:39 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:01:39 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=26.344463348388672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:01:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 21:01:40 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 21:01:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:01:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 21:01:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:01:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid e13e0c74-2071-482a-a2e9-03ea7182b9f0 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid d6eb5a48-11e6-4d15-a10e-41a3067944a2 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 5a0171d4-fddd-424b-9b11-9f78723f3c1b {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 1de6fbc5-8846-4975-9ee4-3b554e1fd667 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:13 user nova-compute[71654]: INFO nova.compute.manager [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Terminating instance
Apr 11 21:02:13 user nova-compute[71654]: DEBUG nova.compute.manager [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-vif-unplugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] No waiting events found dispatching network-vif-unplugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-635717bd-5ede-4a66-b75c-e70fd3cd7724 req-16b074dc-b9c1-4f37-8420-c8e83f29d3e2 service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-vif-unplugged-62239930-fb45-440e-8376-081e29157258 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Instance destroyed successfully.
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.objects.instance [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lazy-loading 'resources' on Instance uuid e13e0c74-2071-482a-a2e9-03ea7182b9f0 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1807635275',display_name='tempest-VolumesActionsTest-instance-1807635275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1807635275',id=34,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:00:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b0794c4a442430b8fc1faf0bd1ee1ca',ramdisk_id='',reservation_id='r-dxafooyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-474021325',owner_user_name='tempest-VolumesActionsTest-474021325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:00:26Z,user_data=None,user_id='c721a6b00fdd479eaf8634f51e4a1b13',uuid=e13e0c74-2071-482a-a2e9-03ea7182b9f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Converting VIF {"id": "62239930-fb45-440e-8376-081e29157258", "address": "fa:16:3e:42:bd:2f", "network": {"id": "3a5877aa-381a-454b-a3d2-3d9acc75413a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-435984464-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9b0794c4a442430b8fc1faf0bd1ee1ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239930-fb", "ovs_interfaceid": "62239930-fb45-440e-8376-081e29157258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG os_vif [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62239930-fb, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:14 user nova-compute[71654]: INFO os_vif [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=62239930-fb45-440e-8376-081e29157258,network=Network(3a5877aa-381a-454b-a3d2-3d9acc75413a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239930-fb')
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Deleting instance files /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0_del
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Deletion of /opt/stack/data/nova/instances/e13e0c74-2071-482a-a2e9-03ea7182b9f0_del complete
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.compute.manager [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 21:02:14 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Took 0.50 seconds to deallocate network for instance.
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-vif-deleted-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.compute.manager [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Neutron deleted interface 62239930-fb45-440e-8376-081e29157258; detaching it from the instance and deleting it from the info cache
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-15733744-9294-4eb3-9163-3499bab599d5 req-421ac906-a1d4-42f5-8ce6-7a830713604a service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Detach interface failed, port_id=62239930-fb45-440e-8376-081e29157258, reason: Instance e13e0c74-2071-482a-a2e9-03ea7182b9f0 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:02:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:14 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Deleted allocations for instance e13e0c74-2071-482a-a2e9-03ea7182b9f0
Apr 11 21:02:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19ba4c48-5652-42d1-bb83-e062917c83e6 tempest-VolumesActionsTest-474021325 tempest-VolumesActionsTest-474021325-project-member] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.570s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received event network-vif-plugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Acquiring lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] Lock "e13e0c74-2071-482a-a2e9-03ea7182b9f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:15 user nova-compute[71654]: DEBUG nova.compute.manager [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] No waiting events found dispatching network-vif-plugged-62239930-fb45-440e-8376-081e29157258 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:15 user nova-compute[71654]: WARNING nova.compute.manager [req-d2d4de9c-f7f3-4038-9283-288584891812 req-658fb5a3-8120-4586-87fd-5a4cda04dd0f service nova] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Received unexpected event network-vif-plugged-62239930-fb45-440e-8376-081e29157258 for instance with vm_state deleted and task_state None.
Apr 11 21:02:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:02:20 user nova-compute[71654]: INFO nova.compute.claims [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Claim successful on node user
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:02:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:02:20 user nova-compute[71654]: INFO nova.virt.block_device [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Booting with volume snapshot abd4d5f1-665f-4a18-9098-8d0e87fa312a at /dev/vda
Apr 11 21:02:20 user nova-compute[71654]: DEBUG nova.policy [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:02:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Successfully created port: ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Successfully updated port: ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "refresh_cache-3bb1abe2-c389-4bae-a193-a4268557fbd2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquired lock "refresh_cache-3bb1abe2-c389-4bae-a193-a4268557fbd2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-changed-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Refreshing instance network info cache due to event network-changed-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Acquiring lock "refresh_cache-3bb1abe2-c389-4bae-a193-a4268557fbd2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Updating instance_info_cache with network_info: [{"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Releasing lock "refresh_cache-3bb1abe2-c389-4bae-a193-a4268557fbd2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Instance network_info: |[{"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Acquired lock "refresh_cache-3bb1abe2-c389-4bae-a193-a4268557fbd2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:02:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Refreshing network info cache for port ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:02:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Updated VIF entry in instance network info cache for port ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:02:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Updating instance_info_cache with network_info: [{"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b87f0c7b-3d2b-4230-9450-0a9ad061fa91 req-390950fc-9c6b-45b0-bdba-3f912d6c3454 service nova] Releasing lock "refresh_cache-3bb1abe2-c389-4bae-a193-a4268557fbd2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:02:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG os_brick.utils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[118224ef-9bb9-405f-a3ea-f33b66091d6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c44438-bcb8-43b3-9c58-1447836ce50c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a34a95-34ff-4641-adcb-1b1cb1add3e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[82467dd1-e853-4fc3-b3a0-6ec5c47f389b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:02:26 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:02:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b87a65-ea94-434f-b270-94c367acb0d6]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG os_brick.utils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:02:26 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Updating existing volume attachment record: e06e9fa0-2989-47f9-9b2e-fb0badbe7fc0 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:02:29 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246934.0694418, e13e0c74-2071-482a-a2e9-03ea7182b9f0 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:02:29 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] VM Stopped (Lifecycle Event)
Apr 11 21:02:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-14140caf-ec4e-4522-b3be-59303bcc2f7f None None] [instance: e13e0c74-2071-482a-a2e9-03ea7182b9f0] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:29 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:02:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:02:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Creating image(s)
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Ensure instance console log exists: /opt/stack/data/nova/instances/3bb1abe2-c389-4bae-a193-a4268557fbd2/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Start _get_guest_xml network_info=[{"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T21:02:18Z,direct_url=<?>,disk_format='qcow2',id=4ed60277-ec4b-497b-9d16-7e1618210958,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1609387619',owner='2c36c3a15f2a413e81544f65c4f6ede4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T21:02:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQWngYRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bb1abe2-c389-4bae-a193-a4268557fbd2', 'attached_at': '', 'detached_at': '', 'volume_id': '5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486', 'serial': '5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'e06e9fa0-2989-47f9-9b2e-fb0badbe7fc0', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:02:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:02:31 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T21:02:18Z,direct_url=<?>,disk_format='qcow2',id=4ed60277-ec4b-497b-9d16-7e1618210958,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1609387619',owner='2c36c3a15f2a413e81544f65c4f6ede4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T21:02:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQWngYRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:02:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:02:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:02:31 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef1c66-c81a-42a2-a994-36e6e1ebf31b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:02:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffa96bb-8179-4fd2-b52a-26d13099f5b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486] added
Apr 11 21:02:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61fecd2-c1b1-4de5-a3e1-d98baf368973]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4487a89-cb7e-45fd-a02b-7b1d999d589a]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQWngYRH {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQWngYRH" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8eea23-3712-4bfb-acc2-794b14dc457f]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQWngYRH'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701155e-dd3b-4022-a518-faa479c91335]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3148518-58db-4e85-ba33-5f5ed4a267d1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:02:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:02:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac0645-a946-46c9-8afb-bc2d85395470]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260]
Apr 11 21:02:31 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260] successful.
Apr 11 21:02:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da8660-f944-4784-a55f-9eb57fcb8399]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe818ae-2555-42ac-a3db-bf863236348d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:02:31 user nova-compute[71654]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 (non-flash)
Apr 11 21:02:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:02:31 user nova-compute[71654]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 (non-flash)
Apr 11 21:02:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a946d231-06c4-4601-a39b-9d60c81c0779]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:02:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQWngYRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23532393339653362', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532393339653362', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1013735479',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1013735479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1013735479',id=38,image_ref='4ed60277-ec4b-497b-9d16-7e1618210958',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-87370tjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-221737316',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:02:21Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=3bb1abe2-c389-4bae-a193-a4268557fbd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.objects.instance [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bb1abe2-c389-4bae-a193-a4268557fbd2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:02:32 user nova-compute[71654]:   <uuid>3bb1abe2-c389-4bae-a193-a4268557fbd2</uuid>
Apr 11 21:02:32 user nova-compute[71654]:   <name>instance-00000026</name>
Apr 11 21:02:32 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:02:32 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:02:32 user nova-compute[71654]:   <metadata>
Apr 11 21:02:32 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:02:32 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:02:32 user nova-compute[71654]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1013735479</nova:name>
Apr 11 21:02:32 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:02:31</nova:creationTime>
Apr 11 21:02:32 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:02:32 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:02:32 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:02:32 user nova-compute[71654]:       <nova:owner>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:user uuid="3e34c9542bd64328a3c8d5cdb7421917">tempest-TestVolumeBootPattern-221737316-project-member</nova:user>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:project uuid="2c36c3a15f2a413e81544f65c4f6ede4">tempest-TestVolumeBootPattern-221737316</nova:project>
Apr 11 21:02:32 user nova-compute[71654]:       </nova:owner>
Apr 11 21:02:32 user nova-compute[71654]:       <nova:root type="image" uuid="4ed60277-ec4b-497b-9d16-7e1618210958"/>
Apr 11 21:02:32 user nova-compute[71654]:       <nova:ports>
Apr 11 21:02:32 user nova-compute[71654]:         <nova:port uuid="ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4">
Apr 11 21:02:32 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:02:32 user nova-compute[71654]:         </nova:port>
Apr 11 21:02:32 user nova-compute[71654]:       </nova:ports>
Apr 11 21:02:32 user nova-compute[71654]:     </nova:instance>
Apr 11 21:02:32 user nova-compute[71654]:   </metadata>
Apr 11 21:02:32 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:02:32 user nova-compute[71654]:     <system>
Apr 11 21:02:32 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:02:32 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:02:32 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:02:32 user nova-compute[71654]:       <entry name="serial">3bb1abe2-c389-4bae-a193-a4268557fbd2</entry>
Apr 11 21:02:32 user nova-compute[71654]:       <entry name="uuid">3bb1abe2-c389-4bae-a193-a4268557fbd2</entry>
Apr 11 21:02:32 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:02:32 user nova-compute[71654]:     </system>
Apr 11 21:02:32 user nova-compute[71654]:   </sysinfo>
Apr 11 21:02:32 user nova-compute[71654]:   <os>
Apr 11 21:02:32 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:02:32 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:02:32 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:02:32 user nova-compute[71654]:   </os>
Apr 11 21:02:32 user nova-compute[71654]:   <features>
Apr 11 21:02:32 user nova-compute[71654]:     <acpi/>
Apr 11 21:02:32 user nova-compute[71654]:     <apic/>
Apr 11 21:02:32 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:02:32 user nova-compute[71654]:   </features>
Apr 11 21:02:32 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:02:32 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:02:32 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:02:32 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:02:32 user nova-compute[71654]:   </clock>
Apr 11 21:02:32 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:02:32 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:02:32 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:02:32 user nova-compute[71654]:   </cpu>
Apr 11 21:02:32 user nova-compute[71654]:   <devices>
Apr 11 21:02:32 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 21:02:32 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:02:32 user nova-compute[71654]:       <source dev="/dev/sdc"/>
Apr 11 21:02:32 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:02:32 user nova-compute[71654]:       <serial>5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486</serial>
Apr 11 21:02:32 user nova-compute[71654]:     </disk>
Apr 11 21:02:32 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:02:32 user nova-compute[71654]:       <mac address="fa:16:3e:51:fb:84"/>
Apr 11 21:02:32 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:02:32 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:02:32 user nova-compute[71654]:       <target dev="tapad6dd711-d6"/>
Apr 11 21:02:32 user nova-compute[71654]:     </interface>
Apr 11 21:02:32 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:02:32 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/3bb1abe2-c389-4bae-a193-a4268557fbd2/console.log" append="off"/>
Apr 11 21:02:32 user nova-compute[71654]:     </serial>
Apr 11 21:02:32 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:02:32 user nova-compute[71654]:     <video>
Apr 11 21:02:32 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:02:32 user nova-compute[71654]:     </video>
Apr 11 21:02:32 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:02:32 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:02:32 user nova-compute[71654]:     </rng>
Apr 11 21:02:32 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:02:32 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:02:32 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:02:32 user nova-compute[71654]:     </memballoon>
Apr 11 21:02:32 user nova-compute[71654]:   </devices>
Apr 11 21:02:32 user nova-compute[71654]: </domain>
Apr 11 21:02:32 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1013735479',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1013735479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1013735479',id=38,image_ref='4ed60277-ec4b-497b-9d16-7e1618210958',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-87370tjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-221737316',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:02:21Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=3bb1abe2-c389-4bae-a193-a4268557fbd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG os_vif [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad6dd711-d6, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad6dd711-d6, col_values=(('external_ids', {'iface-id': 'ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:fb:84', 'vm-uuid': '3bb1abe2-c389-4bae-a193-a4268557fbd2'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:32 user nova-compute[71654]: INFO os_vif [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6')
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:02:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No VIF found with MAC fa:16:3e:51:fb:84, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] No waiting events found dispatching network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:33 user nova-compute[71654]: WARNING nova.compute.manager [req-96231278-ac07-4fe3-a02d-a56a257ab5cb req-56009f33-3ac2-4273-8f44-21499a66be7e service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received unexpected event network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance with vm_state building and task_state spawning.
Apr 11 21:02:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246955.8872237, 3bb1abe2-c389-4bae-a193-a4268557fbd2 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:02:35 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] VM Resumed (Lifecycle Event)
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:02:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Instance spawned successfully.
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:02:35 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246955.8886867, 3bb1abe2-c389-4bae-a193-a4268557fbd2 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:02:35 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] VM Started (Lifecycle Event)
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:02:35 user nova-compute[71654]: INFO nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Took 4.99 seconds to spawn the instance on the hypervisor.
Apr 11 21:02:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:35 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:02:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:36 user nova-compute[71654]: DEBUG nova.compute.manager [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] No waiting events found dispatching network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:36 user nova-compute[71654]: WARNING nova.compute.manager [req-2f292161-22e6-476f-b978-82dc329b310b req-f214937f-e24a-4384-99b4-7d336d46a414 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received unexpected event network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance with vm_state building and task_state spawning.
Apr 11 21:02:36 user nova-compute[71654]: INFO nova.compute.manager [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Took 15.74 seconds to build instance.
Apr 11 21:02:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-b105d29f-5940-45e7-9f0d-6bea935d6faa tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.837s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:02:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid d6eb5a48-11e6-4d15-a10e-41a3067944a2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating instance_info_cache with network_info: [{"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-d6eb5a48-11e6-4d15-a10e-41a3067944a2" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:02:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=26.352890014648438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:02:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "b4313738-e01e-49d3-880b-5c74b75b740a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:02:42 user nova-compute[71654]: INFO nova.compute.claims [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Claim successful on node user
Apr 11 21:02:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:02:42 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.policy [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8557484fdf27419384420c986b776a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf42a499ff3c43afaea1b716c0e801ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:02:42 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Creating image(s)
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "/opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "/opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.061s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.150s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk 1073741824" returned: 0 in 0.049s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Successfully created port: f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Cannot resize image /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lazy-loading 'migration_context' on Instance uuid b4313738-e01e-49d3-880b-5c74b75b740a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Ensure instance console log exists: /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Successfully updated port: f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "refresh_cache-b4313738-e01e-49d3-880b-5c74b75b740a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquired lock "refresh_cache-b4313738-e01e-49d3-880b-5c74b75b740a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-changed-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.compute.manager [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Refreshing instance network info cache due to event network-changed-f6226fd1-15be-473c-93dd-3bcee5e8c530. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Acquiring lock "refresh_cache-b4313738-e01e-49d3-880b-5c74b75b740a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.neutron [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Updating instance_info_cache with network_info: [{"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Releasing lock "refresh_cache-b4313738-e01e-49d3-880b-5c74b75b740a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Instance network_info: |[{"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Acquired lock "refresh_cache-b4313738-e01e-49d3-880b-5c74b75b740a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.neutron [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Refreshing network info cache for port f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Start _get_guest_xml network_info=[{"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:02:44 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:02:44 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1529368978',display_name='tempest-ServersNegativeTestJSON-server-1529368978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1529368978',id=39,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf42a499ff3c43afaea1b716c0e801ac',ramdisk_id='',reservation_id='r-ugxpral8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1791140415',owner_user_name='tempest-ServersNegativeTestJSON-1791140415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:02:43Z,user_data=None,user_id='8557484fdf27419384420c986b776a90',uuid=b4313738-e01e-49d3-880b-5c74b75b740a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converting VIF {"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lazy-loading 'pci_devices' on Instance uuid b4313738-e01e-49d3-880b-5c74b75b740a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:02:44 user nova-compute[71654]:   <uuid>b4313738-e01e-49d3-880b-5c74b75b740a</uuid>
Apr 11 21:02:44 user nova-compute[71654]:   <name>instance-00000027</name>
Apr 11 21:02:44 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:02:44 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:02:44 user nova-compute[71654]:   <metadata>
Apr 11 21:02:44 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:02:44 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:02:44 user nova-compute[71654]:       <nova:name>tempest-ServersNegativeTestJSON-server-1529368978</nova:name>
Apr 11 21:02:44 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:02:44</nova:creationTime>
Apr 11 21:02:44 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:02:44 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:02:44 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:02:44 user nova-compute[71654]:       <nova:owner>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:user uuid="8557484fdf27419384420c986b776a90">tempest-ServersNegativeTestJSON-1791140415-project-member</nova:user>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:project uuid="cf42a499ff3c43afaea1b716c0e801ac">tempest-ServersNegativeTestJSON-1791140415</nova:project>
Apr 11 21:02:44 user nova-compute[71654]:       </nova:owner>
Apr 11 21:02:44 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:02:44 user nova-compute[71654]:       <nova:ports>
Apr 11 21:02:44 user nova-compute[71654]:         <nova:port uuid="f6226fd1-15be-473c-93dd-3bcee5e8c530">
Apr 11 21:02:44 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 21:02:44 user nova-compute[71654]:         </nova:port>
Apr 11 21:02:44 user nova-compute[71654]:       </nova:ports>
Apr 11 21:02:44 user nova-compute[71654]:     </nova:instance>
Apr 11 21:02:44 user nova-compute[71654]:   </metadata>
Apr 11 21:02:44 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:02:44 user nova-compute[71654]:     <system>
Apr 11 21:02:44 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:02:44 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:02:44 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:02:44 user nova-compute[71654]:       <entry name="serial">b4313738-e01e-49d3-880b-5c74b75b740a</entry>
Apr 11 21:02:44 user nova-compute[71654]:       <entry name="uuid">b4313738-e01e-49d3-880b-5c74b75b740a</entry>
Apr 11 21:02:44 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:02:44 user nova-compute[71654]:     </system>
Apr 11 21:02:44 user nova-compute[71654]:   </sysinfo>
Apr 11 21:02:44 user nova-compute[71654]:   <os>
Apr 11 21:02:44 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:02:44 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:02:44 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:02:44 user nova-compute[71654]:   </os>
Apr 11 21:02:44 user nova-compute[71654]:   <features>
Apr 11 21:02:44 user nova-compute[71654]:     <acpi/>
Apr 11 21:02:44 user nova-compute[71654]:     <apic/>
Apr 11 21:02:44 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:02:44 user nova-compute[71654]:   </features>
Apr 11 21:02:44 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:02:44 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:02:44 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:02:44 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:02:44 user nova-compute[71654]:   </clock>
Apr 11 21:02:44 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:02:44 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:02:44 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:02:44 user nova-compute[71654]:   </cpu>
Apr 11 21:02:44 user nova-compute[71654]:   <devices>
Apr 11 21:02:44 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:02:44 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:02:44 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk"/>
Apr 11 21:02:44 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:02:44 user nova-compute[71654]:     </disk>
Apr 11 21:02:44 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:02:44 user nova-compute[71654]:       <mac address="fa:16:3e:96:8b:03"/>
Apr 11 21:02:44 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:02:44 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:02:44 user nova-compute[71654]:       <target dev="tapf6226fd1-15"/>
Apr 11 21:02:44 user nova-compute[71654]:     </interface>
Apr 11 21:02:44 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:02:44 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/console.log" append="off"/>
Apr 11 21:02:44 user nova-compute[71654]:     </serial>
Apr 11 21:02:44 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:02:44 user nova-compute[71654]:     <video>
Apr 11 21:02:44 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:02:44 user nova-compute[71654]:     </video>
Apr 11 21:02:44 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:02:44 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:02:44 user nova-compute[71654]:     </rng>
Apr 11 21:02:44 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:02:44 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:02:44 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:02:44 user nova-compute[71654]:     </memballoon>
Apr 11 21:02:44 user nova-compute[71654]:   </devices>
Apr 11 21:02:44 user nova-compute[71654]: </domain>
Apr 11 21:02:44 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1529368978',display_name='tempest-ServersNegativeTestJSON-server-1529368978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1529368978',id=39,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf42a499ff3c43afaea1b716c0e801ac',ramdisk_id='',reservation_id='r-ugxpral8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1791140415',owner_user_name='tempest-ServersNegativeTestJSON-1791140415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:02:43Z,user_data=None,user_id='8557484fdf27419384420c986b776a90',uuid=b4313738-e01e-49d3-880b-5c74b75b740a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converting VIF {"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG os_vif [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6226fd1-15, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6226fd1-15, col_values=(('external_ids', {'iface-id': 'f6226fd1-15be-473c-93dd-3bcee5e8c530', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:8b:03', 'vm-uuid': 'b4313738-e01e-49d3-880b-5c74b75b740a'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:45 user nova-compute[71654]: INFO os_vif [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15')
Apr 11 21:02:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:02:45 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] No VIF found with MAC fa:16:3e:96:8b:03, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:02:45 user nova-compute[71654]: DEBUG nova.network.neutron [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Updated VIF entry in instance network info cache for port f6226fd1-15be-473c-93dd-3bcee5e8c530. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:02:45 user nova-compute[71654]: DEBUG nova.network.neutron [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Updating instance_info_cache with network_info: [{"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-16d06c13-1f9d-4240-af7e-03ac444e8dcf req-2c3d0c30-c329-4d9c-b88e-d20343f1f754 service nova] Releasing lock "refresh_cache-b4313738-e01e-49d3-880b-5c74b75b740a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:46 user nova-compute[71654]: DEBUG nova.compute.manager [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] No waiting events found dispatching network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:46 user nova-compute[71654]: WARNING nova.compute.manager [req-fb0418b8-25c0-43c3-926e-d8ef008876c9 req-7f3c8ab1-7a29-4a5f-9a03-867b6be3e077 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received unexpected event network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance with vm_state building and task_state spawning.
Apr 11 21:02:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246968.380208, b4313738-e01e-49d3-880b-5c74b75b740a => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] VM Resumed (Lifecycle Event)
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Instance spawned successfully.
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681246968.3815417, b4313738-e01e-49d3-880b-5c74b75b740a => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] VM Started (Lifecycle Event)
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:02:48 user nova-compute[71654]: INFO nova.compute.manager [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Took 6.22 seconds to build instance.
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:48 user nova-compute[71654]: DEBUG nova.compute.manager [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] No waiting events found dispatching network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:48 user nova-compute[71654]: WARNING nova.compute.manager [req-f9129626-9ab4-41af-8f7c-e825e9aa08c3 req-1147da02-435b-4736-9365-6b960a34f738 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received unexpected event network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance with vm_state active and task_state None.
Apr 11 21:02:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8483358b-4c59-4f95-931d-dd4e1bde7006 tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "b4313738-e01e-49d3-880b-5c74b75b740a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.311s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:55 user nova-compute[71654]: INFO nova.compute.manager [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Terminating instance
Apr 11 21:02:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-vif-unplugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] No waiting events found dispatching network-vif-unplugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:55 user nova-compute[71654]: DEBUG nova.compute.manager [req-bf952361-b76d-4bbf-b428-123c2ca3d2eb req-522601fe-dfef-46bf-8c3c-e188a772f7be service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-vif-unplugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:02:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Instance destroyed successfully.
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.objects.instance [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lazy-loading 'resources' on Instance uuid 1de6fbc5-8846-4975-9ee4-3b554e1fd667 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2046167664',display_name='tempest-VolumesNegativeTest-instance-2046167664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2046167664',id=37,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:01:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90afd2eb3cec40029264c2f35b2546a3',ramdisk_id='',reservation_id='r-vbfmmgvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1031545147',owner_user_name='tempest-VolumesNegativeTest-1031545147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:01:12Z,user_data=None,user_id='57f22d3582bd4d2da3b18d2d0b68c29b',uuid=1de6fbc5-8846-4975-9ee4-3b554e1fd667,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Converting VIF {"id": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "address": "fa:16:3e:c9:1c:7b", "network": {"id": "314bc5fe-68c8-4448-aedc-fe2f9fb02f21", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3759513651464b9dad082fa5bedbfbfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed7c111-5c", "ovs_interfaceid": "eed7c111-5c02-4a4e-b9eb-27ee25efc7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG os_vif [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeed7c111-5c, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:02:56 user nova-compute[71654]: INFO os_vif [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:1c:7b,bridge_name='br-int',has_traffic_filtering=True,id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc,network=Network(314bc5fe-68c8-4448-aedc-fe2f9fb02f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed7c111-5c')
Apr 11 21:02:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Deleting instance files /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667_del
Apr 11 21:02:56 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Deletion of /opt/stack/data/nova/instances/1de6fbc5-8846-4975-9ee4-3b554e1fd667_del complete
Apr 11 21:02:56 user nova-compute[71654]: INFO nova.compute.manager [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 11 21:02:56 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:56 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Took 0.49 seconds to deallocate network for instance.
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-vif-deleted-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:56 user nova-compute[71654]: INFO nova.compute.manager [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Neutron deleted interface eed7c111-5c02-4a4e-b9eb-27ee25efc7dc; detaching it from the instance and deleting it from the info cache
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.network.neutron [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG nova.compute.manager [req-88649882-ae9c-4d7c-8816-2a92419bce33 req-4a8516d7-2243-46b2-a709-bee909a1d7b7 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Detach interface failed, port_id=eed7c111-5c02-4a4e-b9eb-27ee25efc7dc, reason: Instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:56 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:57 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Deleted allocations for instance 1de6fbc5-8846-4975-9ee4-3b554e1fd667
Apr 11 21:02:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0d676561-f40d-4052-bfa0-877630b255e2 tempest-VolumesNegativeTest-1031545147 tempest-VolumesNegativeTest-1031545147-project-member] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.569s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received event network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Acquiring lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] Lock "1de6fbc5-8846-4975-9ee4-3b554e1fd667-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:02:57 user nova-compute[71654]: DEBUG nova.compute.manager [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] No waiting events found dispatching network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:02:57 user nova-compute[71654]: WARNING nova.compute.manager [req-96d3ec8c-1db0-4d74-887b-cb8d495f66c1 req-c3427081-020e-402e-9bd8-8885b507e8d9 service nova] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Received unexpected event network-vif-plugged-eed7c111-5c02-4a4e-b9eb-27ee25efc7dc for instance with vm_state deleted and task_state None.
Apr 11 21:03:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:11 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681246976.1830516, 1de6fbc5-8846-4975-9ee4-3b554e1fd667 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:03:11 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] VM Stopped (Lifecycle Event)
Apr 11 21:03:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8aab7f01-fb93-4c2b-9c2d-2a0832af7a24 None None] [instance: 1de6fbc5-8846-4975-9ee4-3b554e1fd667] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:03:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:20 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:03:26 user nova-compute[71654]: INFO nova.compute.claims [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Claim successful on node user
Apr 11 21:03:26 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:03:26 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:03:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.policy [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:03:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Creating image(s)
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "/opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "/opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "/opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk 1073741824" returned: 0 in 0.060s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Successfully created port: 1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Cannot resize image /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lazy-loading 'migration_context' on Instance uuid 063e3089-9149-48d5-bf0c-6f4749ed2689 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Ensure instance console log exists: /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Successfully updated port: 1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "refresh_cache-063e3089-9149-48d5-bf0c-6f4749ed2689" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquired lock "refresh_cache-063e3089-9149-48d5-bf0c-6f4749ed2689" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-changed-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Refreshing instance network info cache due to event network-changed-1d8a8ce5-b487-4db2-9e49-093237df52ab. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Acquiring lock "refresh_cache-063e3089-9149-48d5-bf0c-6f4749ed2689" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.neutron [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Updating instance_info_cache with network_info: [{"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Releasing lock "refresh_cache-063e3089-9149-48d5-bf0c-6f4749ed2689" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Instance network_info: |[{"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Acquired lock "refresh_cache-063e3089-9149-48d5-bf0c-6f4749ed2689" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.neutron [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Refreshing network info cache for port 1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Start _get_guest_xml network_info=[{"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:03:28 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:03:28 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-788986832',display_name='tempest-VolumesActionsTest-instance-788986832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-788986832',id=40,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb572d88b49979f0c987e7c14e078',ramdisk_id='',reservation_id='r-wooninr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-938970583',owner_user_name='tempest-VolumesActionsTest-938970583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:03:27Z,user_data=None,user_id='1a7549924a014f40a6568d7d771b6957',uuid=063e3089-9149-48d5-bf0c-6f4749ed2689,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converting VIF {"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.objects.instance [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lazy-loading 'pci_devices' on Instance uuid 063e3089-9149-48d5-bf0c-6f4749ed2689 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:03:28 user nova-compute[71654]:   <uuid>063e3089-9149-48d5-bf0c-6f4749ed2689</uuid>
Apr 11 21:03:28 user nova-compute[71654]:   <name>instance-00000028</name>
Apr 11 21:03:28 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:03:28 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:03:28 user nova-compute[71654]:   <metadata>
Apr 11 21:03:28 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:03:28 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:03:28 user nova-compute[71654]:       <nova:name>tempest-VolumesActionsTest-instance-788986832</nova:name>
Apr 11 21:03:28 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:03:28</nova:creationTime>
Apr 11 21:03:28 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:03:28 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:03:28 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:03:28 user nova-compute[71654]:       <nova:owner>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:user uuid="1a7549924a014f40a6568d7d771b6957">tempest-VolumesActionsTest-938970583-project-member</nova:user>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:project uuid="be7eb572d88b49979f0c987e7c14e078">tempest-VolumesActionsTest-938970583</nova:project>
Apr 11 21:03:28 user nova-compute[71654]:       </nova:owner>
Apr 11 21:03:28 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:03:28 user nova-compute[71654]:       <nova:ports>
Apr 11 21:03:28 user nova-compute[71654]:         <nova:port uuid="1d8a8ce5-b487-4db2-9e49-093237df52ab">
Apr 11 21:03:28 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 21:03:28 user nova-compute[71654]:         </nova:port>
Apr 11 21:03:28 user nova-compute[71654]:       </nova:ports>
Apr 11 21:03:28 user nova-compute[71654]:     </nova:instance>
Apr 11 21:03:28 user nova-compute[71654]:   </metadata>
Apr 11 21:03:28 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:03:28 user nova-compute[71654]:     <system>
Apr 11 21:03:28 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:03:28 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:03:28 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:03:28 user nova-compute[71654]:       <entry name="serial">063e3089-9149-48d5-bf0c-6f4749ed2689</entry>
Apr 11 21:03:28 user nova-compute[71654]:       <entry name="uuid">063e3089-9149-48d5-bf0c-6f4749ed2689</entry>
Apr 11 21:03:28 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:03:28 user nova-compute[71654]:     </system>
Apr 11 21:03:28 user nova-compute[71654]:   </sysinfo>
Apr 11 21:03:28 user nova-compute[71654]:   <os>
Apr 11 21:03:28 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:03:28 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:03:28 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:03:28 user nova-compute[71654]:   </os>
Apr 11 21:03:28 user nova-compute[71654]:   <features>
Apr 11 21:03:28 user nova-compute[71654]:     <acpi/>
Apr 11 21:03:28 user nova-compute[71654]:     <apic/>
Apr 11 21:03:28 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:03:28 user nova-compute[71654]:   </features>
Apr 11 21:03:28 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:03:28 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:03:28 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:03:28 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:03:28 user nova-compute[71654]:   </clock>
Apr 11 21:03:28 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:03:28 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:03:28 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:03:28 user nova-compute[71654]:   </cpu>
Apr 11 21:03:28 user nova-compute[71654]:   <devices>
Apr 11 21:03:28 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:03:28 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:03:28 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk"/>
Apr 11 21:03:28 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:03:28 user nova-compute[71654]:     </disk>
Apr 11 21:03:28 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:03:28 user nova-compute[71654]:       <mac address="fa:16:3e:07:29:1e"/>
Apr 11 21:03:28 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:03:28 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:03:28 user nova-compute[71654]:       <target dev="tap1d8a8ce5-b4"/>
Apr 11 21:03:28 user nova-compute[71654]:     </interface>
Apr 11 21:03:28 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:03:28 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/console.log" append="off"/>
Apr 11 21:03:28 user nova-compute[71654]:     </serial>
Apr 11 21:03:28 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:03:28 user nova-compute[71654]:     <video>
Apr 11 21:03:28 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:03:28 user nova-compute[71654]:     </video>
Apr 11 21:03:28 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:03:28 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:03:28 user nova-compute[71654]:     </rng>
Apr 11 21:03:28 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:03:28 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:03:28 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:03:28 user nova-compute[71654]:     </memballoon>
Apr 11 21:03:28 user nova-compute[71654]:   </devices>
Apr 11 21:03:28 user nova-compute[71654]: </domain>
Apr 11 21:03:28 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-788986832',display_name='tempest-VolumesActionsTest-instance-788986832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-788986832',id=40,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb572d88b49979f0c987e7c14e078',ramdisk_id='',reservation_id='r-wooninr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-938970583',owner_user_name='tempest-VolumesActionsTest-938970583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:03:27Z,user_data=None,user_id='1a7549924a014f40a6568d7d771b6957',uuid=063e3089-9149-48d5-bf0c-6f4749ed2689,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converting VIF {"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG os_vif [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d8a8ce5-b4, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d8a8ce5-b4, col_values=(('external_ids', {'iface-id': '1d8a8ce5-b487-4db2-9e49-093237df52ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:29:1e', 'vm-uuid': '063e3089-9149-48d5-bf0c-6f4749ed2689'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:03:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:28 user nova-compute[71654]: INFO os_vif [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4')
Apr 11 21:03:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:03:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] No VIF found with MAC fa:16:3e:07:29:1e, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:03:29 user nova-compute[71654]: DEBUG nova.network.neutron [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Updated VIF entry in instance network info cache for port 1d8a8ce5-b487-4db2-9e49-093237df52ab. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:03:29 user nova-compute[71654]: DEBUG nova.network.neutron [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Updating instance_info_cache with network_info: [{"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:03:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3d36fa3e-2742-4cd2-8ecb-9911bc0eaadf req-ffceae0e-4a06-4387-b0e2-c1f07a53d96d service nova] Releasing lock "refresh_cache-063e3089-9149-48d5-bf0c-6f4749ed2689" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:03:29 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG nova.compute.manager [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] No waiting events found dispatching network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:03:30 user nova-compute[71654]: WARNING nova.compute.manager [req-f762d353-d487-439e-965e-11cd8b90fc0f req-6ad4dbe9-0744-4529-a7d9-87a5f26104f3 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received unexpected event network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab for instance with vm_state building and task_state spawning.
Apr 11 21:03:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247012.4578667, 063e3089-9149-48d5-bf0c-6f4749ed2689 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] VM Resumed (Lifecycle Event)
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Instance spawned successfully.
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247012.45957, 063e3089-9149-48d5-bf0c-6f4749ed2689 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] VM Started (Lifecycle Event)
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] No waiting events found dispatching network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:03:32 user nova-compute[71654]: WARNING nova.compute.manager [req-741d43a2-aa87-4a79-b336-94b525babdc8 req-57590c4e-7466-4541-ae98-5f1f5334ea19 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received unexpected event network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab for instance with vm_state building and task_state spawning.
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Took 5.36 seconds to spawn the instance on the hypervisor.
Apr 11 21:03:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:03:32 user nova-compute[71654]: INFO nova.compute.manager [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Took 5.92 seconds to build instance.
Apr 11 21:03:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-63f431fa-b842-4739-b0a4-e5f3c8f74502 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.047s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:03:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:03:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:03:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:03:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8287MB free_disk=26.348678588867188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 3bb1abe2-c389-4bae-a193-a4268557fbd2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b4313738-e01e-49d3-880b-5c74b75b740a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:03:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:03:41 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:41 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:03:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:03:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:03:41 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:03:42 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:03:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:03:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:03:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:03:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:03:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:03:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:03:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:03:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:03:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:03:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:10 user nova-compute[71654]: INFO nova.compute.manager [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Terminating instance
Apr 11 21:04:10 user nova-compute[71654]: DEBUG nova.compute.manager [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:11 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Instance destroyed successfully.
Apr 11 21:04:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'resources' on Instance uuid 3bb1abe2-c389-4bae-a193-a4268557fbd2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1013735479',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1013735479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1013735479',id=38,image_ref='4ed60277-ec4b-497b-9d16-7e1618210958',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-87370tjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-221737316',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:02:36Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=3bb1abe2-c389-4bae-a193-a4268557fbd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "address": "fa:16:3e:51:fb:84", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6dd711-d6", "ovs_interfaceid": "ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_vif [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad6dd711-d6, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:04:11 user nova-compute[71654]: INFO os_vif [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:fb:84,bridge_name='br-int',has_traffic_filtering=True,id=ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6dd711-d6')
Apr 11 21:04:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQWngYRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:04:11 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e528c49-6a1e-4025-80db-973b0d34dd4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:04:11 user nova-compute[71654]: No targets found.
Apr 11 21:04:11 user nova-compute[71654]: iSNS:
Apr 11 21:04:11 user nova-compute[71654]: No targets found.
Apr 11 21:04:11 user nova-compute[71654]: STATIC:
Apr 11 21:04:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd
Apr 11 21:04:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:04:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:04:11 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486
Apr 11 21:04:11 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:04:11 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:04:11 user nova-compute[71654]: FIRMWARE:
Apr 11 21:04:11 user nova-compute[71654]: No targets found.
Apr 11 21:04:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:04:11 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:04:11 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e720bf-8eb3-4c18-b078-e4a2e130192c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97822f4-e9de-4f0b-ba39-7ce3dba0db79]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:04:11 user nova-compute[71654]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 (non-flash)
Apr 11 21:04:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:04:11 user nova-compute[71654]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 (non-flash)
Apr 11 21:04:11 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46e7f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efbac29-0b95-4751-96d4-299e456040f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cbe32b-125f-43a9-abe0-5587485a4b31]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f18831-6945-4607-ada2-3a17c555ec6e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[016bfec0-27c5-4ea0-91d5-1d8e0233be1e]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f49eb117', '/dev/disk/by-id/scsi-23532393339653362', '/dev/disk/by-id/scsi-1SCST_BIOf49eb117-52939e3b3999b9ac') {{(pid=81862) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 21:04:11 user nova-compute[71654]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f49eb117
Apr 11 21:04:11 user nova-compute[71654]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23532393339653362
Apr 11 21:04:11 user nova-compute[71654]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf49eb117-52939e3b3999b9ac
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc7b420-925c-43dd-889a-c14c46b72e3c]: (4, None) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bafb30c-f1d1-4361-ba90-ff3533e7b2ff]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:04:11 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-vif-unplugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] No waiting events found dispatching network-vif-unplugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-215d6b08-19d1-481b-87ce-d16c8bff1c81 req-d45bc79b-0fa0-40ed-977d-d06bf6fcf701 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-vif-unplugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e094cd-791f-4d41-8e97-f8e62fb7772e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260]
Apr 11 21:04:12 user nova-compute[71654]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486, portal: 172.16.0.220,3260] successful.
Apr 11 21:04:12 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[743a7e9d-f89e-441d-ad2b-ab81643215ed]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== disconnect_volume: return (323ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:04:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Deleting instance files /opt/stack/data/nova/instances/3bb1abe2-c389-4bae-a193-a4268557fbd2_del
Apr 11 21:04:12 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Deletion of /opt/stack/data/nova/instances/3bb1abe2-c389-4bae-a193-a4268557fbd2_del complete
Apr 11 21:04:12 user nova-compute[71654]: INFO nova.compute.manager [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 11 21:04:12 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:12 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:04:12 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Took 0.48 seconds to deallocate network for instance.
Apr 11 21:04:13 user nova-compute[71654]: INFO nova.compute.manager [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Took 0.85 seconds to detach 1 volumes for instance.
Apr 11 21:04:13 user nova-compute[71654]: DEBUG nova.compute.manager [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Deleting volume: 5470b4bb-7ae8-45f8-a8d2-1fae7fd8a486 {{(pid=71654) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 21:04:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:13 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:04:13 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:04:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:13 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Deleted allocations for instance 3bb1abe2-c389-4bae-a193-a4268557fbd2
Apr 11 21:04:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-89ef893b-26c1-4fad-abb4-90274045fa91 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.014s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Acquiring lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] Lock "3bb1abe2-c389-4bae-a193-a4268557fbd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] No waiting events found dispatching network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:04:14 user nova-compute[71654]: WARNING nova.compute.manager [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received unexpected event network-vif-plugged-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 for instance with vm_state deleted and task_state None.
Apr 11 21:04:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-75f92c49-eae2-4c43-96fd-114568d17d39 req-45f66b40-d8fd-4de8-b267-3c98b431fbb0 service nova] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Received event network-vif-deleted-ad6dd711-d6df-4aa8-af1e-cf8ab2e1f2f4 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:15 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:04:20 user nova-compute[71654]: INFO nova.compute.claims [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Claim successful on node user
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:04:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.policy [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03d8e96524894243b3226f4df3c42376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6233baae51b44238a630a75ccea0bdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:04:20 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Creating image(s)
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "/opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "/opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:20 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk 1073741824" returned: 0 in 0.053s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Successfully created port: ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Cannot resize image /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'migration_context' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Ensure instance console log exists: /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Successfully updated port: ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquired lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-changed-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.compute.manager [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Refreshing instance network info cache due to event network-changed-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Acquiring lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.neutron [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Releasing lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Instance network_info: |[{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Acquired lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.neutron [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Refreshing network info cache for port ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Start _get_guest_xml network_info=[{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:04:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:04:22 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:04:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1796483703',display_name='tempest-SnapshotDataIntegrityTests-server-1796483703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1796483703',id=41,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXcw4d2/8Jyu4uN3Xyg+X/eTr/DWWnycZDnu/3iBhuvtkr6XoB58mgAQA2Bk3kZzz9pP6hq8KlOXoNwcGwWwN+8S8qZEYZRoUCYs8XACvyH5uN5IV1XGuLn09Beb+3ruQ==',key_name='tempest-SnapshotDataIntegrityTests-1721986425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6233baae51b44238a630a75ccea0bdbf',ramdisk_id='',reservation_id='r-azwh83ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-906456256',owner_user_name='tempest-SnapshotDataIntegrityTests-906456256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:04:21Z,user_data=None,user_id='03d8e96524894243b3226f4df3c42376',uuid=b5969528-6603-4329-8cc3-8d97e162b8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Converting VIF {"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.objects.instance [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'pci_devices' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:04:22 user nova-compute[71654]:   <uuid>b5969528-6603-4329-8cc3-8d97e162b8cb</uuid>
Apr 11 21:04:22 user nova-compute[71654]:   <name>instance-00000029</name>
Apr 11 21:04:22 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:04:22 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:04:22 user nova-compute[71654]:   <metadata>
Apr 11 21:04:22 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:04:22 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:04:22 user nova-compute[71654]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1796483703</nova:name>
Apr 11 21:04:22 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:04:22</nova:creationTime>
Apr 11 21:04:22 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:04:22 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:04:22 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:04:22 user nova-compute[71654]:       <nova:owner>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:user uuid="03d8e96524894243b3226f4df3c42376">tempest-SnapshotDataIntegrityTests-906456256-project-member</nova:user>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:project uuid="6233baae51b44238a630a75ccea0bdbf">tempest-SnapshotDataIntegrityTests-906456256</nova:project>
Apr 11 21:04:22 user nova-compute[71654]:       </nova:owner>
Apr 11 21:04:22 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:04:22 user nova-compute[71654]:       <nova:ports>
Apr 11 21:04:22 user nova-compute[71654]:         <nova:port uuid="ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb">
Apr 11 21:04:22 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:04:22 user nova-compute[71654]:         </nova:port>
Apr 11 21:04:22 user nova-compute[71654]:       </nova:ports>
Apr 11 21:04:22 user nova-compute[71654]:     </nova:instance>
Apr 11 21:04:22 user nova-compute[71654]:   </metadata>
Apr 11 21:04:22 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:04:22 user nova-compute[71654]:     <system>
Apr 11 21:04:22 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:04:22 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:04:22 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:04:22 user nova-compute[71654]:       <entry name="serial">b5969528-6603-4329-8cc3-8d97e162b8cb</entry>
Apr 11 21:04:22 user nova-compute[71654]:       <entry name="uuid">b5969528-6603-4329-8cc3-8d97e162b8cb</entry>
Apr 11 21:04:22 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:04:22 user nova-compute[71654]:     </system>
Apr 11 21:04:22 user nova-compute[71654]:   </sysinfo>
Apr 11 21:04:22 user nova-compute[71654]:   <os>
Apr 11 21:04:22 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:04:22 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:04:22 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:04:22 user nova-compute[71654]:   </os>
Apr 11 21:04:22 user nova-compute[71654]:   <features>
Apr 11 21:04:22 user nova-compute[71654]:     <acpi/>
Apr 11 21:04:22 user nova-compute[71654]:     <apic/>
Apr 11 21:04:22 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:04:22 user nova-compute[71654]:   </features>
Apr 11 21:04:22 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:04:22 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:04:22 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:04:22 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:04:22 user nova-compute[71654]:   </clock>
Apr 11 21:04:22 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:04:22 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:04:22 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:04:22 user nova-compute[71654]:   </cpu>
Apr 11 21:04:22 user nova-compute[71654]:   <devices>
Apr 11 21:04:22 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:04:22 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:04:22 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk"/>
Apr 11 21:04:22 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:04:22 user nova-compute[71654]:     </disk>
Apr 11 21:04:22 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:04:22 user nova-compute[71654]:       <mac address="fa:16:3e:a9:f3:3f"/>
Apr 11 21:04:22 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:04:22 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:04:22 user nova-compute[71654]:       <target dev="tapce77e6bc-e9"/>
Apr 11 21:04:22 user nova-compute[71654]:     </interface>
Apr 11 21:04:22 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:04:22 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/console.log" append="off"/>
Apr 11 21:04:22 user nova-compute[71654]:     </serial>
Apr 11 21:04:22 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:04:22 user nova-compute[71654]:     <video>
Apr 11 21:04:22 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:04:22 user nova-compute[71654]:     </video>
Apr 11 21:04:22 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:04:22 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:04:22 user nova-compute[71654]:     </rng>
Apr 11 21:04:22 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:04:22 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:04:22 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:04:22 user nova-compute[71654]:     </memballoon>
Apr 11 21:04:22 user nova-compute[71654]:   </devices>
Apr 11 21:04:22 user nova-compute[71654]: </domain>
Apr 11 21:04:22 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:04:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1796483703',display_name='tempest-SnapshotDataIntegrityTests-server-1796483703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1796483703',id=41,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXcw4d2/8Jyu4uN3Xyg+X/eTr/DWWnycZDnu/3iBhuvtkr6XoB58mgAQA2Bk3kZzz9pP6hq8KlOXoNwcGwWwN+8S8qZEYZRoUCYs8XACvyH5uN5IV1XGuLn09Beb+3ruQ==',key_name='tempest-SnapshotDataIntegrityTests-1721986425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6233baae51b44238a630a75ccea0bdbf',ramdisk_id='',reservation_id='r-azwh83ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-906456256',owner_user_name='tempest-SnapshotDataIntegrityTests-906456256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:04:21Z,user_data=None,user_id='03d8e96524894243b3226f4df3c42376',uuid=b5969528-6603-4329-8cc3-8d97e162b8cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Converting VIF {"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG os_vif [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce77e6bc-e9, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce77e6bc-e9, col_values=(('external_ids', {'iface-id': 'ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:f3:3f', 'vm-uuid': 'b5969528-6603-4329-8cc3-8d97e162b8cb'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:22 user nova-compute[71654]: INFO os_vif [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9')
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:04:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No VIF found with MAC fa:16:3e:a9:f3:3f, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:04:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updated VIF entry in instance network info cache for port ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:04:23 user nova-compute[71654]: DEBUG nova.network.neutron [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:04:23 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b37bcfb9-2c70-463e-a0fb-36ff688bd77c req-1c18d6b7-e065-4d72-8964-313709b4c65d service nova] Releasing lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] No waiting events found dispatching network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:04:24 user nova-compute[71654]: WARNING nova.compute.manager [req-da8f2c12-fee4-4694-8084-1b6756cebf3e req-ec76fcc1-8b4a-4a3a-86cc-a2932fd7973c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received unexpected event network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance with vm_state building and task_state spawning.
Apr 11 21:04:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247066.3769236, b5969528-6603-4329-8cc3-8d97e162b8cb => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] VM Resumed (Lifecycle Event)
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Instance spawned successfully.
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247066.3786707, b5969528-6603-4329-8cc3-8d97e162b8cb => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] VM Started (Lifecycle Event)
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Took 5.52 seconds to spawn the instance on the hypervisor.
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Took 6.19 seconds to build instance.
Apr 11 21:04:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-c98601db-70ce-4663-91bf-11b92ae0ccc0 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.274s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247051.690158, 3bb1abe2-c389-4bae-a193-a4268557fbd2 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:04:26 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] VM Stopped (Lifecycle Event)
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] No waiting events found dispatching network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:04:26 user nova-compute[71654]: WARNING nova.compute.manager [req-a2bf34ff-7202-4e69-a1e3-1ae0865f2521 req-c2956f95-3002-465e-adaa-2bc657f31c38 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received unexpected event network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance with vm_state active and task_state None.
Apr 11 21:04:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a600317b-55e8-4699-a915-bcbd307fa46d None None] [instance: 3bb1abe2-c389-4bae-a193-a4268557fbd2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:04:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "b4313738-e01e-49d3-880b-5c74b75b740a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:32 user nova-compute[71654]: INFO nova.compute.manager [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Terminating instance
Apr 11 21:04:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-vif-unplugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] No waiting events found dispatching network-vif-unplugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-680f0452-0ee8-41b6-b31d-794f5857f4e9 req-69d1ed22-42e7-4ffe-84c9-a9f0937dbeca service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-vif-unplugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Instance destroyed successfully.
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lazy-loading 'resources' on Instance uuid b4313738-e01e-49d3-880b-5c74b75b740a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1529368978',display_name='tempest-ServersNegativeTestJSON-server-1529368978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1529368978',id=39,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf42a499ff3c43afaea1b716c0e801ac',ramdisk_id='',reservation_id='r-ugxpral8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1791140415',owner_user_name='tempest-ServersNegativeTestJSON-1791140415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:02:49Z,user_data=None,user_id='8557484fdf27419384420c986b776a90',uuid=b4313738-e01e-49d3-880b-5c74b75b740a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converting VIF {"id": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "address": "fa:16:3e:96:8b:03", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6226fd1-15", "ovs_interfaceid": "f6226fd1-15be-473c-93dd-3bcee5e8c530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG os_vif [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6226fd1-15, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:04:33 user nova-compute[71654]: INFO os_vif [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:8b:03,bridge_name='br-int',has_traffic_filtering=True,id=f6226fd1-15be-473c-93dd-3bcee5e8c530,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6226fd1-15')
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Deleting instance files /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a_del
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Deletion of /opt/stack/data/nova/instances/b4313738-e01e-49d3-880b-5c74b75b740a_del complete
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.compute.manager [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 11 21:04:33 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Took 0.45 seconds to deallocate network for instance.
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-vif-deleted-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.compute.manager [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Neutron deleted interface f6226fd1-15be-473c-93dd-3bcee5e8c530; detaching it from the instance and deleting it from the info cache
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.network.neutron [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-60a5b82f-872d-4487-b0ff-7e884282a950 req-bf148fa2-400e-48ec-bd3a-cfa2ee19e8cc service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Detach interface failed, port_id=f6226fd1-15be-473c-93dd-3bcee5e8c530, reason: Instance b4313738-e01e-49d3-880b-5c74b75b740a could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:04:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:33 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Deleted allocations for instance b4313738-e01e-49d3-880b-5c74b75b740a
Apr 11 21:04:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-300b0090-b414-402d-8bb1-5cff5c469ddc tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "b4313738-e01e-49d3-880b-5c74b75b740a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.697s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received event network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:04:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Acquiring lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] Lock "b4313738-e01e-49d3-880b-5c74b75b740a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:34 user nova-compute[71654]: DEBUG nova.compute.manager [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] No waiting events found dispatching network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:04:34 user nova-compute[71654]: WARNING nova.compute.manager [req-8c66cef5-1d35-439b-b488-75b5f660e2ea req-54e2830b-1560-4e7f-98b3-6ec146d480b7 service nova] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Received unexpected event network-vif-plugged-f6226fd1-15be-473c-93dd-3bcee5e8c530 for instance with vm_state deleted and task_state None.
Apr 11 21:04:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:04:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:04:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:04:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8322MB free_disk=26.318378448486328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b5969528-6603-4329-8cc3-8d97e162b8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:04:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:04:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:04:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:04:43 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:43 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:04:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:47 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247072.9944968, b4313738-e01e-49d3-880b-5c74b75b740a => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:04:47 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] VM Stopped (Lifecycle Event)
Apr 11 21:04:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d9164648-817b-4b59-bfec-29d7af6ef975 None None] [instance: b4313738-e01e-49d3-880b-5c74b75b740a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:04:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:04:58 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:02 user nova-compute[71654]: INFO nova.compute.manager [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Terminating instance
Apr 11 21:05:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-vif-unplugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] No waiting events found dispatching network-vif-unplugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:05:02 user nova-compute[71654]: DEBUG nova.compute.manager [req-fb865d4c-be7a-4db2-ada5-2cd8dd039339 req-e75a93de-f261-450c-845a-d5d8211f42dd service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-vif-unplugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Instance destroyed successfully.
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.objects.instance [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'resources' on Instance uuid d6eb5a48-11e6-4d15-a10e-41a3067944a2 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-222867129',display_name='tempest-TestVolumeBootPattern-volume-backed-server-222867129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-222867129',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-782kz0ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:00:36Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=d6eb5a48-11e6-4d15-a10e-41a3067944a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "address": "fa:16:3e:b2:1b:0e", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6e2e51-c6", "ovs_interfaceid": "4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_vif [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a6e2e51-c6, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:05:03 user nova-compute[71654]: INFO os_vif [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:1b:0e,bridge_name='br-int',has_traffic_filtering=True,id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6e2e51-c6')
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXwFvmEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:05:03 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882a3fa-6253-43e5-a080-236c4a80e752]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:05:03 user nova-compute[71654]: No targets found.
Apr 11 21:05:03 user nova-compute[71654]: iSNS:
Apr 11 21:05:03 user nova-compute[71654]: No targets found.
Apr 11 21:05:03 user nova-compute[71654]: STATIC:
Apr 11 21:05:03 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd
Apr 11 21:05:03 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:05:03 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:05:03 user nova-compute[71654]: FIRMWARE:
Apr 11 21:05:03 user nova-compute[71654]: No targets found.
Apr 11 21:05:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:05:03 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:05:03 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efc4b39-e52c-4615-bc8a-1610d8a8eb79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1ee75-34b7-426c-aef7-b1d5836327ae]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:05:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd (non-flash)
Apr 11 21:05:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb2025e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a6606d-33e5-47f9-b999-13d25c2facd3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d73cdca-8252-41b8-a3b0-fce63194ce5d]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6200fb1b-a2d8-43fd-972f-35eba6523a20]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c0262-465a-46c3-a2f7-4c389591b884]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfb41c74f-587ef4dafa32593f', '/dev/disk/by-id/scsi-23538376566346461', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb41c74f') {{(pid=81862) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68e81f7-68c3-4990-ab02-546a6072520d]: (4, None) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa24c8d-91e7-4e82-95bc-6b31c507d0b1]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[71503385-e702-4fba-9f06-983ec6acde9c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260]
Apr 11 21:05:03 user nova-compute[71654]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd, portal: 172.16.0.220,3260] successful.
Apr 11 21:05:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c5d32e-dcf2-4b9f-8377-a8b3341d6626]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== disconnect_volume: return (307ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:05:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Deleting instance files /opt/stack/data/nova/instances/d6eb5a48-11e6-4d15-a10e-41a3067944a2_del
Apr 11 21:05:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Deletion of /opt/stack/data/nova/instances/d6eb5a48-11e6-4d15-a10e-41a3067944a2_del complete
Apr 11 21:05:03 user nova-compute[71654]: INFO nova.compute.manager [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 11 21:05:03 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:05:03 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-vif-deleted-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:05:04 user nova-compute[71654]: INFO nova.compute.manager [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Neutron deleted interface 4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a; detaching it from the instance and deleting it from the info cache
Apr 11 21:05:04 user nova-compute[71654]: DEBUG nova.network.neutron [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:05:04 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Took 0.47 seconds to deallocate network for instance.
Apr 11 21:05:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-697fe2bc-c17a-4170-99be-7a7aa802c143 req-d4a2e63d-920b-4152-80e9-c75f3b9f7fc5 service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Detach interface failed, port_id=4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a, reason: Instance d6eb5a48-11e6-4d15-a10e-41a3067944a2 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received event network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Acquiring lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:04 user nova-compute[71654]: DEBUG nova.compute.manager [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] No waiting events found dispatching network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:05:04 user nova-compute[71654]: WARNING nova.compute.manager [req-af69db5e-e3fb-46a3-a1af-99971c879622 req-9c43c840-7d70-4f2e-855c-e03891befede service nova] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Received unexpected event network-vif-plugged-4a6e2e51-c6f7-4b5d-afe4-f4d25281a51a for instance with vm_state active and task_state deleting.
Apr 11 21:05:05 user nova-compute[71654]: INFO nova.compute.manager [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 21:05:05 user nova-compute[71654]: DEBUG nova.compute.manager [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Deleting volume: ef43f426-0d3e-4fb8-9096-e1e3f9c87ebd {{(pid=71654) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 21:05:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:05 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:05:05 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:05:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:05 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Deleted allocations for instance d6eb5a48-11e6-4d15-a10e-41a3067944a2
Apr 11 21:05:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-48879e48-95b5-4bdc-b5d4-7dccdedc2b21 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "d6eb5a48-11e6-4d15-a10e-41a3067944a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:08 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:17 user nova-compute[71654]: INFO nova.compute.manager [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Terminating instance
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.compute.manager [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-vif-unplugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] No waiting events found dispatching network-vif-unplugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.compute.manager [req-c929d95f-6d11-4308-be3d-fa77fc659669 req-ca8d03fb-70bf-41cc-b044-13f0cb63cf0f service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-vif-unplugged-1d8a8ce5-b487-4db2-9e49-093237df52ab for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:05:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Instance destroyed successfully.
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lazy-loading 'resources' on Instance uuid 063e3089-9149-48d5-bf0c-6f4749ed2689 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-788986832',display_name='tempest-VolumesActionsTest-instance-788986832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-788986832',id=40,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:03:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be7eb572d88b49979f0c987e7c14e078',ramdisk_id='',reservation_id='r-wooninr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-938970583',owner_user_name='tempest-VolumesActionsTest-938970583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:03:33Z,user_data=None,user_id='1a7549924a014f40a6568d7d771b6957',uuid=063e3089-9149-48d5-bf0c-6f4749ed2689,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converting VIF {"id": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "address": "fa:16:3e:07:29:1e", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8ce5-b4", "ovs_interfaceid": "1d8a8ce5-b487-4db2-9e49-093237df52ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG os_vif [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d8a8ce5-b4, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:05:17 user nova-compute[71654]: INFO os_vif [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:29:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8ce5-b487-4db2-9e49-093237df52ab,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8ce5-b4')
Apr 11 21:05:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Deleting instance files /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689_del
Apr 11 21:05:17 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Deletion of /opt/stack/data/nova/instances/063e3089-9149-48d5-bf0c-6f4749ed2689_del complete
Apr 11 21:05:17 user nova-compute[71654]: INFO nova.compute.manager [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 21:05:17 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:05:17 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247103.3326056, d6eb5a48-11e6-4d15-a10e-41a3067944a2 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:05:18 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] VM Stopped (Lifecycle Event)
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.compute.manager [None req-e1bd444b-8a07-47a7-8e2c-e50c446b371c None None] [instance: d6eb5a48-11e6-4d15-a10e-41a3067944a2] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:05:18 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Took 0.74 seconds to deallocate network for instance.
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-vif-deleted-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:05:18 user nova-compute[71654]: INFO nova.compute.manager [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Neutron deleted interface 1d8a8ce5-b487-4db2-9e49-093237df52ab; detaching it from the instance and deleting it from the info cache
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.network.neutron [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.compute.manager [req-1f272309-9569-48ae-8c36-b02fd88d1fdf req-ed9d0a37-d4b3-44cb-acd0-b8576cedb270 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Detach interface failed, port_id=1d8a8ce5-b487-4db2-9e49-093237df52ab, reason: Instance 063e3089-9149-48d5-bf0c-6f4749ed2689 could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:05:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:18 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Deleted allocations for instance 063e3089-9149-48d5-bf0c-6f4749ed2689
Apr 11 21:05:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8150a6e4-0434-4671-afb6-f523bfc34da8 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received event network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:05:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Acquiring lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] Lock "063e3089-9149-48d5-bf0c-6f4749ed2689-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] No waiting events found dispatching network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:05:19 user nova-compute[71654]: WARNING nova.compute.manager [req-4b21cef1-4760-4424-b793-1a827963a1a8 req-f12fd612-b88c-4fa0-8c5f-f5996221f728 service nova] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Received unexpected event network-vif-plugged-1d8a8ce5-b487-4db2-9e49-093237df52ab for instance with vm_state deleted and task_state None.
Apr 11 21:05:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:05:31 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:31 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:05:32 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247117.7960026, 063e3089-9149-48d5-bf0c-6f4749ed2689 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:05:32 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] VM Stopped (Lifecycle Event)
Apr 11 21:05:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-301f3c7e-7a8b-4119-9458-cafc8bdcf9cf None None] [instance: 063e3089-9149-48d5-bf0c-6f4749ed2689] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:05:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:38 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:39 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:05:40 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=26.33566665649414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b5969528-6603-4329-8cc3-8d97e162b8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:05:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:05:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 5a0171d4-fddd-424b-9b11-9f78723f3c1b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:05:43 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:05:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:05:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:53 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:05:57 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:05:57 user nova-compute[71654]: INFO nova.compute.claims [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Claim successful on node user
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:05:58 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:05:58 user nova-compute[71654]: INFO nova.virt.block_device [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Booting with volume 86fa1780-adb9-4e29-b424-0e7bfeee531d at /dev/vda
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.policy [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e34c9542bd64328a3c8d5cdb7421917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c36c3a15f2a413e81544f65c4f6ede4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG os_brick.utils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e8b50-0d05-447e-86b4-4de1300b106a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba025144-629e-4cdf-83e8-3d07feb8ab96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aa2528-7840-411d-9991-638a88f38108]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ba351-fae1-4e0d-9928-b76123c00e84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:05:58 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:05:58 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[86787bda-9236-4707-b655-b6db42c64f89]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG os_brick.utils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:05:58 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updating existing volume attachment record: ebe086d5-d275-41f5-b456-60dffa9777e3 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:05:59 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Successfully created port: 4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Successfully updated port: 4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquired lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-changed-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Refreshing instance network info cache due to event network-changed-4b20f01b-63c6-48df-ad3e-656d1ba8178d. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Acquiring lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.network.neutron [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updating instance_info_cache with network_info: [{"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Releasing lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Instance network_info: |[{"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Acquired lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:06:00 user nova-compute[71654]: DEBUG nova.network.neutron [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Refreshing network info cache for port 4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:06:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updated VIF entry in instance network info cache for port 4b20f01b-63c6-48df-ad3e-656d1ba8178d. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:06:01 user nova-compute[71654]: DEBUG nova.network.neutron [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updating instance_info_cache with network_info: [{"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:06:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4ad05b42-d220-4817-8a4d-dc01f86db5ab req-ad9b039b-60a2-4ff2-8a98-74aad17cddaa service nova] Releasing lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:06:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:06:03 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Creating image(s)
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Did not create local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Ensure instance console log exists: /opt/stack/data/nova/instances/ac91ed34-8f95-477d-a951-efa13ccff67b/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Start _get_guest_xml network_info=[{"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtfiDVJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac91ed34-8f95-477d-a951-efa13ccff67b', 'attached_at': '', 'detached_at': '', 'volume_id': '86fa1780-adb9-4e29-b424-0e7bfeee531d', 'serial': '86fa1780-adb9-4e29-b424-0e7bfeee531d'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ebe086d5-d275-41f5-b456-60dffa9777e3', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:06:03 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:06:03 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtfiDVJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:06:03 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:06:03 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:06:03 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c23a98-5574-4acc-8c22-637e8c0ef47f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:06:03 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4452a21-5544-4c9e-8306-0e667e0666f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d] added
Apr 11 21:06:03 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe9cf2-9b5a-44da-ad6a-d3867ff99080]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a01777d-a2bd-420c-a55d-5f5b950f3915]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtfiDVJK {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtfiDVJK" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e558ae-3ef7-4c5e-8023-5635e573f0ba]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FtfiDVJK'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d859d2-d879-47a1-b02c-f2164e93b416]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9619c0-ac66-45ef-b492-d25263012c59]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:06:03 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:06:03 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:06:03 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:06:03 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:06:03 user nova-compute[71654]: 
Apr 11 21:06:03 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a48a9-831e-4489-9a3b-ea0721549046]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260]
Apr 11 21:06:04 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260] successful.
Apr 11 21:06:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae430f-ff53-43cc-95af-44140d5b7410]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39b117-2b99-47ff-8cf8-1da00fc83794]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:04 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e237df-6a1f-40e2-bbcc-1dd23ecf6a38]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:04 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtfiDVJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26665306637643439', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665306637643439', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1308181043',display_name='tempest-TestVolumeBootPattern-server-1308181043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1308181043',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDrqhkrym1CfZlb+r+GlNopr6aTwGNF6ss7D41NMi4Nte1p/A4pHRSGMcx1DkMqprm9O4VBj6JyfebwxXg2lgckuEdr334CnYf3AxzSbFaUNZmKliEG84dDSfywNcdtnQ==',key_name='tempest-TestVolumeBootPattern-1519294118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-kxu55h5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:05:59Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=ac91ed34-8f95-477d-a951-efa13ccff67b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.objects.instance [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'pci_devices' on Instance uuid ac91ed34-8f95-477d-a951-efa13ccff67b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:06:05 user nova-compute[71654]:   <uuid>ac91ed34-8f95-477d-a951-efa13ccff67b</uuid>
Apr 11 21:06:05 user nova-compute[71654]:   <name>instance-0000002a</name>
Apr 11 21:06:05 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:06:05 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:06:05 user nova-compute[71654]:   <metadata>
Apr 11 21:06:05 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:06:05 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:06:05 user nova-compute[71654]:       <nova:name>tempest-TestVolumeBootPattern-server-1308181043</nova:name>
Apr 11 21:06:05 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:06:03</nova:creationTime>
Apr 11 21:06:05 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:06:05 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:06:05 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:06:05 user nova-compute[71654]:       <nova:owner>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:user uuid="3e34c9542bd64328a3c8d5cdb7421917">tempest-TestVolumeBootPattern-221737316-project-member</nova:user>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:project uuid="2c36c3a15f2a413e81544f65c4f6ede4">tempest-TestVolumeBootPattern-221737316</nova:project>
Apr 11 21:06:05 user nova-compute[71654]:       </nova:owner>
Apr 11 21:06:05 user nova-compute[71654]:       <nova:ports>
Apr 11 21:06:05 user nova-compute[71654]:         <nova:port uuid="4b20f01b-63c6-48df-ad3e-656d1ba8178d">
Apr 11 21:06:05 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:06:05 user nova-compute[71654]:         </nova:port>
Apr 11 21:06:05 user nova-compute[71654]:       </nova:ports>
Apr 11 21:06:05 user nova-compute[71654]:     </nova:instance>
Apr 11 21:06:05 user nova-compute[71654]:   </metadata>
Apr 11 21:06:05 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:06:05 user nova-compute[71654]:     <system>
Apr 11 21:06:05 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:06:05 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:06:05 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:06:05 user nova-compute[71654]:       <entry name="serial">ac91ed34-8f95-477d-a951-efa13ccff67b</entry>
Apr 11 21:06:05 user nova-compute[71654]:       <entry name="uuid">ac91ed34-8f95-477d-a951-efa13ccff67b</entry>
Apr 11 21:06:05 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:06:05 user nova-compute[71654]:     </system>
Apr 11 21:06:05 user nova-compute[71654]:   </sysinfo>
Apr 11 21:06:05 user nova-compute[71654]:   <os>
Apr 11 21:06:05 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:06:05 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:06:05 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:06:05 user nova-compute[71654]:   </os>
Apr 11 21:06:05 user nova-compute[71654]:   <features>
Apr 11 21:06:05 user nova-compute[71654]:     <acpi/>
Apr 11 21:06:05 user nova-compute[71654]:     <apic/>
Apr 11 21:06:05 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:06:05 user nova-compute[71654]:   </features>
Apr 11 21:06:05 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:06:05 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:06:05 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:06:05 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:06:05 user nova-compute[71654]:   </clock>
Apr 11 21:06:05 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:06:05 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:06:05 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:06:05 user nova-compute[71654]:   </cpu>
Apr 11 21:06:05 user nova-compute[71654]:   <devices>
Apr 11 21:06:05 user nova-compute[71654]:     <disk type="block" device="disk">
Apr 11 21:06:05 user nova-compute[71654]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:06:05 user nova-compute[71654]:       <source dev="/dev/sdb"/>
Apr 11 21:06:05 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:06:05 user nova-compute[71654]:       <serial>86fa1780-adb9-4e29-b424-0e7bfeee531d</serial>
Apr 11 21:06:05 user nova-compute[71654]:     </disk>
Apr 11 21:06:05 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:06:05 user nova-compute[71654]:       <mac address="fa:16:3e:d7:85:01"/>
Apr 11 21:06:05 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:06:05 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:06:05 user nova-compute[71654]:       <target dev="tap4b20f01b-63"/>
Apr 11 21:06:05 user nova-compute[71654]:     </interface>
Apr 11 21:06:05 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:06:05 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/ac91ed34-8f95-477d-a951-efa13ccff67b/console.log" append="off"/>
Apr 11 21:06:05 user nova-compute[71654]:     </serial>
Apr 11 21:06:05 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:06:05 user nova-compute[71654]:     <video>
Apr 11 21:06:05 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:06:05 user nova-compute[71654]:     </video>
Apr 11 21:06:05 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:06:05 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:06:05 user nova-compute[71654]:     </rng>
Apr 11 21:06:05 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:06:05 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:06:05 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:06:05 user nova-compute[71654]:     </memballoon>
Apr 11 21:06:05 user nova-compute[71654]:   </devices>
Apr 11 21:06:05 user nova-compute[71654]: </domain>
Apr 11 21:06:05 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1308181043',display_name='tempest-TestVolumeBootPattern-server-1308181043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1308181043',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDrqhkrym1CfZlb+r+GlNopr6aTwGNF6ss7D41NMi4Nte1p/A4pHRSGMcx1DkMqprm9O4VBj6JyfebwxXg2lgckuEdr334CnYf3AxzSbFaUNZmKliEG84dDSfywNcdtnQ==',key_name='tempest-TestVolumeBootPattern-1519294118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-kxu55h5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:05:59Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=ac91ed34-8f95-477d-a951-efa13ccff67b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG os_vif [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b20f01b-63, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b20f01b-63, col_values=(('external_ids', {'iface-id': '4b20f01b-63c6-48df-ad3e-656d1ba8178d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:85:01', 'vm-uuid': 'ac91ed34-8f95-477d-a951-efa13ccff67b'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:05 user nova-compute[71654]: INFO os_vif [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63')
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:06:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] No VIF found with MAC fa:16:3e:d7:85:01, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:06 user nova-compute[71654]: DEBUG nova.compute.manager [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] No waiting events found dispatching network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:06:06 user nova-compute[71654]: WARNING nova.compute.manager [req-beb4f1f1-f405-4ca6-b4c1-93c542a13356 req-f64bc445-1323-4215-9202-e88b5e6b7b9c service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received unexpected event network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance with vm_state building and task_state spawning.
Apr 11 21:06:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "0a7a0115-1cce-4dab-8207-812e4836a257" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247168.6050522, ac91ed34-8f95-477d-a951-efa13ccff67b => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] VM Resumed (Lifecycle Event)
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Instance spawned successfully.
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247168.6078618, ac91ed34-8f95-477d-a951-efa13ccff67b => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] VM Started (Lifecycle Event)
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] No waiting events found dispatching network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:06:08 user nova-compute[71654]: WARNING nova.compute.manager [req-4e6a2f45-1689-4737-b65e-24e9d5ee1998 req-6fadbe5a-e038-454c-8db2-7ce23eb1f04e service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received unexpected event network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance with vm_state building and task_state spawning.
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.claims [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Claim successful on node user
Apr 11 21:06:08 user nova-compute[71654]: INFO nova.compute.manager [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Took 10.95 seconds to build instance.
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-dc4f0fc7-7507-4da9-8d0b-358c5522e2c2 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.049s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:06:09 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.policy [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a7549924a014f40a6568d7d771b6957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7eb572d88b49979f0c987e7c14e078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:06:09 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Creating image(s)
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "/opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "/opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.147s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk 1073741824" returned: 0 in 0.051s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Cannot resize image /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lazy-loading 'migration_context' on Instance uuid 0a7a0115-1cce-4dab-8207-812e4836a257 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Ensure instance console log exists: /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:09 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Successfully created port: 1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Successfully updated port: 1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "refresh_cache-0a7a0115-1cce-4dab-8207-812e4836a257" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquired lock "refresh_cache-0a7a0115-1cce-4dab-8207-812e4836a257" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-changed-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG nova.compute.manager [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Refreshing instance network info cache due to event network-changed-1617eac0-ffe9-4e3f-9a40-2c82eaf35578. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Acquiring lock "refresh_cache-0a7a0115-1cce-4dab-8207-812e4836a257" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:06:10 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.neutron [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Updating instance_info_cache with network_info: [{"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Releasing lock "refresh_cache-0a7a0115-1cce-4dab-8207-812e4836a257" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Instance network_info: |[{"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Acquired lock "refresh_cache-0a7a0115-1cce-4dab-8207-812e4836a257" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Refreshing network info cache for port 1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Start _get_guest_xml network_info=[{"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:06:11 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:06:11 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-966792145',display_name='tempest-VolumesActionsTest-instance-966792145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-966792145',id=43,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb572d88b49979f0c987e7c14e078',ramdisk_id='',reservation_id='r-8lq0x001',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-938970583',owner_user_name='tempest-VolumesActionsTest-938970583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:06:09Z,user_data=None,user_id='1a7549924a014f40a6568d7d771b6957',uuid=0a7a0115-1cce-4dab-8207-812e4836a257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converting VIF {"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.objects.instance [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a7a0115-1cce-4dab-8207-812e4836a257 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:06:11 user nova-compute[71654]:   <uuid>0a7a0115-1cce-4dab-8207-812e4836a257</uuid>
Apr 11 21:06:11 user nova-compute[71654]:   <name>instance-0000002b</name>
Apr 11 21:06:11 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:06:11 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:06:11 user nova-compute[71654]:   <metadata>
Apr 11 21:06:11 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:06:11 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:06:11 user nova-compute[71654]:       <nova:name>tempest-VolumesActionsTest-instance-966792145</nova:name>
Apr 11 21:06:11 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:06:11</nova:creationTime>
Apr 11 21:06:11 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:06:11 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:06:11 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:06:11 user nova-compute[71654]:       <nova:owner>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:user uuid="1a7549924a014f40a6568d7d771b6957">tempest-VolumesActionsTest-938970583-project-member</nova:user>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:project uuid="be7eb572d88b49979f0c987e7c14e078">tempest-VolumesActionsTest-938970583</nova:project>
Apr 11 21:06:11 user nova-compute[71654]:       </nova:owner>
Apr 11 21:06:11 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:06:11 user nova-compute[71654]:       <nova:ports>
Apr 11 21:06:11 user nova-compute[71654]:         <nova:port uuid="1617eac0-ffe9-4e3f-9a40-2c82eaf35578">
Apr 11 21:06:11 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:06:11 user nova-compute[71654]:         </nova:port>
Apr 11 21:06:11 user nova-compute[71654]:       </nova:ports>
Apr 11 21:06:11 user nova-compute[71654]:     </nova:instance>
Apr 11 21:06:11 user nova-compute[71654]:   </metadata>
Apr 11 21:06:11 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:06:11 user nova-compute[71654]:     <system>
Apr 11 21:06:11 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:06:11 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:06:11 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:06:11 user nova-compute[71654]:       <entry name="serial">0a7a0115-1cce-4dab-8207-812e4836a257</entry>
Apr 11 21:06:11 user nova-compute[71654]:       <entry name="uuid">0a7a0115-1cce-4dab-8207-812e4836a257</entry>
Apr 11 21:06:11 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:06:11 user nova-compute[71654]:     </system>
Apr 11 21:06:11 user nova-compute[71654]:   </sysinfo>
Apr 11 21:06:11 user nova-compute[71654]:   <os>
Apr 11 21:06:11 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:06:11 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:06:11 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:06:11 user nova-compute[71654]:   </os>
Apr 11 21:06:11 user nova-compute[71654]:   <features>
Apr 11 21:06:11 user nova-compute[71654]:     <acpi/>
Apr 11 21:06:11 user nova-compute[71654]:     <apic/>
Apr 11 21:06:11 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:06:11 user nova-compute[71654]:   </features>
Apr 11 21:06:11 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:06:11 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:06:11 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:06:11 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:06:11 user nova-compute[71654]:   </clock>
Apr 11 21:06:11 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:06:11 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:06:11 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:06:11 user nova-compute[71654]:   </cpu>
Apr 11 21:06:11 user nova-compute[71654]:   <devices>
Apr 11 21:06:11 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:06:11 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:06:11 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk"/>
Apr 11 21:06:11 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:06:11 user nova-compute[71654]:     </disk>
Apr 11 21:06:11 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:06:11 user nova-compute[71654]:       <mac address="fa:16:3e:06:38:c4"/>
Apr 11 21:06:11 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:06:11 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:06:11 user nova-compute[71654]:       <target dev="tap1617eac0-ff"/>
Apr 11 21:06:11 user nova-compute[71654]:     </interface>
Apr 11 21:06:11 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:06:11 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/console.log" append="off"/>
Apr 11 21:06:11 user nova-compute[71654]:     </serial>
Apr 11 21:06:11 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:06:11 user nova-compute[71654]:     <video>
Apr 11 21:06:11 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:06:11 user nova-compute[71654]:     </video>
Apr 11 21:06:11 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:06:11 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:06:11 user nova-compute[71654]:     </rng>
Apr 11 21:06:11 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:06:11 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:06:11 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:06:11 user nova-compute[71654]:     </memballoon>
Apr 11 21:06:11 user nova-compute[71654]:   </devices>
Apr 11 21:06:11 user nova-compute[71654]: </domain>
Apr 11 21:06:11 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-966792145',display_name='tempest-VolumesActionsTest-instance-966792145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-966792145',id=43,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be7eb572d88b49979f0c987e7c14e078',ramdisk_id='',reservation_id='r-8lq0x001',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-938970583',owner_user_name='tempest-VolumesActionsTest-938970583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:06:09Z,user_data=None,user_id='1a7549924a014f40a6568d7d771b6957',uuid=0a7a0115-1cce-4dab-8207-812e4836a257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converting VIF {"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG os_vif [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1617eac0-ff, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1617eac0-ff, col_values=(('external_ids', {'iface-id': '1617eac0-ffe9-4e3f-9a40-2c82eaf35578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:38:c4', 'vm-uuid': '0a7a0115-1cce-4dab-8207-812e4836a257'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:11 user nova-compute[71654]: INFO os_vif [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff')
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] No VIF found with MAC fa:16:3e:06:38:c4, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Updated VIF entry in instance network info cache for port 1617eac0-ffe9-4e3f-9a40-2c82eaf35578. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG nova.network.neutron [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Updating instance_info_cache with network_info: [{"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:06:11 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8eb9b170-89a7-43e1-bf70-505b50ff6960 req-1fcb8859-c4f7-40fe-8a38-01b23c9e9796 service nova] Releasing lock "refresh_cache-0a7a0115-1cce-4dab-8207-812e4836a257" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:12 user nova-compute[71654]: DEBUG nova.compute.manager [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] No waiting events found dispatching network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:06:12 user nova-compute[71654]: WARNING nova.compute.manager [req-1211b9d7-8647-41a6-a150-97016e0899d1 req-2c98c95f-6712-4f62-ab2a-98418fe475d1 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received unexpected event network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance with vm_state building and task_state spawning.
Apr 11 21:06:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-changed-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG nova.compute.manager [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Refreshing instance network info cache due to event network-changed-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Acquiring lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Acquired lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG nova.network.neutron [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Refreshing network info cache for port ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG nova.objects.instance [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:06:13 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:14 user nova-compute[71654]: INFO nova.compute.manager [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attaching volume 8ff5fef0-1950-4555-b748-8508d8567ef8 to /dev/vdb
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updated VIF entry in instance network info cache for port ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.network.neutron [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3e44c809-6c00-4451-9722-8ca9dd82ae4d req-0ebcb3ed-7b19-47e7-aba4-c9dc9697fa42 service nova] Releasing lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG os_brick.utils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[487683fd-12e9-4cd2-b7f6-d601f70d51c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[627ddeec-d99a-46a3-8575-003a8e936aca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a4d524-4abf-4615-bd1f-ed9a2363036e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f24af2-4fe9-4980-8620-d81525778d1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:06:14 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c9b92d-b158-4b27-9c3c-e011eda9a141]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG os_brick.utils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating existing volume attachment record: 18639e7c-1f8b-4fbc-8e46-d3949acf16be {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247174.8642225, 0a7a0115-1cce-4dab-8207-812e4836a257 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:06:14 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] VM Resumed (Lifecycle Event)
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:06:14 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Instance spawned successfully.
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:06:14 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247174.8718042, 0a7a0115-1cce-4dab-8207-812e4836a257 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:06:14 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] VM Started (Lifecycle Event)
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] No waiting events found dispatching network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:06:14 user nova-compute[71654]: WARNING nova.compute.manager [req-6403abc4-be3b-47bf-8ce3-e326fdc78088 req-997e4ab3-6044-401c-ae44-851c9ea69c3b service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received unexpected event network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance with vm_state building and task_state spawning.
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:06:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:06:15 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:06:15 user nova-compute[71654]: INFO nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 11 21:06:15 user nova-compute[71654]: DEBUG nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:06:15 user nova-compute[71654]: INFO nova.compute.manager [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Took 6.47 seconds to build instance.
Apr 11 21:06:15 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-7dd23aea-81f6-4d9c-a0dd-51e10526b315 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "0a7a0115-1cce-4dab-8207-812e4836a257" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.588s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ukAcpoiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:06:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:06:18 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:06:18 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[69534028-c4b3-4725-98d8-325984dee7b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:06:18 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[316e2d7e-88e2-449b-8d82-c303f54c69e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8] added
Apr 11 21:06:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0bae6-067c-44ae-8101-d449e542d749]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bcca59-7ad7-4096-ba34-3cb4bb97c888]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ukAcpoiS {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ukAcpoiS" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc70c715-b9f9-4dfb-85a9-974ff4918ddf]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ukAcpoiS'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0103ac8-84ed-4caf-b77c-0692b68f7b65]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771b063-fbad-4aa4-872a-835f06727470]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0874ae-ae09-47e7-8a6b-9493ddf5e1dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260]
Apr 11 21:06:18 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260] successful.
Apr 11 21:06:18 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac31098b-3161-4214-be73-553ca86f2198]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a4c65e-ee2c-4b28-bde0-5cc6a7a91364]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:19 user nova-compute[71654]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 (non-flash)
Apr 11 21:06:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:19 user nova-compute[71654]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 (non-flash)
Apr 11 21:06:19 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ae667-1da6-4dfe-b93a-a9073b41a79d]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:19 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ukAcpoiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23333356532323830', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333356532323830', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG nova.objects.instance [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:06:20 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:06:20 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 21:06:20 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:06:20 user nova-compute[71654]:   <serial>8ff5fef0-1950-4555-b748-8508d8567ef8</serial>
Apr 11 21:06:20 user nova-compute[71654]: </disk>
Apr 11 21:06:20 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No VIF found with MAC fa:16:3e:a9:f3:3f, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:06:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-16253485-64b5-4838-9eef-d3e8210e1105 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.627s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:27 user nova-compute[71654]: INFO nova.compute.manager [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Detaching volume 8ff5fef0-1950-4555-b748-8508d8567ef8
Apr 11 21:06:27 user nova-compute[71654]: INFO nova.virt.block_device [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attempting to driver detach volume 8ff5fef0-1950-4555-b748-8508d8567ef8 from mountpoint /dev/vdb
Apr 11 21:06:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Attempting to detach device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:06:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:06:27 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:06:27 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 21:06:27 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:06:27 user nova-compute[71654]:   <serial>8ff5fef0-1950-4555-b748-8508d8567ef8</serial>
Apr 11 21:06:27 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:06:27 user nova-compute[71654]: </disk>
Apr 11 21:06:27 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:06:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config.
Apr 11 21:06:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:06:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:06:27 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:06:27 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 21:06:27 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:06:27 user nova-compute[71654]:   <serial>8ff5fef0-1950-4555-b748-8508d8567ef8</serial>
Apr 11 21:06:27 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:06:27 user nova-compute[71654]: </disk>
Apr 11 21:06:27 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681247188.1884234, b5969528-6603-4329-8cc3-8d97e162b8cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:06:28 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config.
Apr 11 21:06:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ukAcpoiS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:06:28 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff17e5d-a352-4283-adcd-778882c63eed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:06:28 user nova-compute[71654]: No targets found.
Apr 11 21:06:28 user nova-compute[71654]: iSNS:
Apr 11 21:06:28 user nova-compute[71654]: No targets found.
Apr 11 21:06:28 user nova-compute[71654]: STATIC:
Apr 11 21:06:28 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8
Apr 11 21:06:28 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:06:28 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:06:28 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d
Apr 11 21:06:28 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:06:28 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:06:28 user nova-compute[71654]: FIRMWARE:
Apr 11 21:06:28 user nova-compute[71654]: No targets found.
Apr 11 21:06:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:06:28 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:06:28 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0399d2b-6794-46fa-9e5a-797f8ff39d89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a9546-1a52-49f1-afe0-03b4fe2f2174]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:28 user nova-compute[71654]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 (non-flash)
Apr 11 21:06:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:06:28 user nova-compute[71654]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 (non-flash)
Apr 11 21:06:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46f89f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7249918-25f2-420e-a117-0248bb894fcd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c56b2-73a3-4397-b753-5de48f3a4481]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ecaf2e-5fb1-4748-a4d7-e4e9f44b45f8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea466b8-a938-4549-bc60-59f05327dda6]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1763a0-e14f-4903-b2c4-de5e31b55a47]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[434cf1ed-d2dd-44de-a3c1-c73ff5596d24]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260]
Apr 11 21:06:28 user nova-compute[71654]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8, portal: 172.16.0.220,3260] successful.
Apr 11 21:06:28 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff5fef0-1950-4555-b748-8508d8567ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabc7fc-4a12-43d6-b27c-927886e1e4d4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== disconnect_volume: return (271ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:06:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:06:29 user nova-compute[71654]: DEBUG nova.objects.instance [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:06:29 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-76263b43-fa21-4857-b987-daffa4100799 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:06:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:33 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:40 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:06:41 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:06:42 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:06:42 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=26.31324005126953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b5969528-6603-4329-8cc3-8d97e162b8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ac91ed34-8f95-477d-a951-efa13ccff67b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0a7a0115-1cce-4dab-8207-812e4836a257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:06:42 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:06:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:06:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:06:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:06:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 21:06:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 21:06:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:06:56 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:06:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 21:07:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:07:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:19 user nova-compute[71654]: INFO nova.compute.manager [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attaching volume 31b81ba1-36ae-4686-814c-aca8bc2354d3 to /dev/vdb
Apr 11 21:07:19 user nova-compute[71654]: DEBUG os_brick.utils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5154340-ba92-4d9d-8860-86f63e0ac5e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5f6442-827b-414e-aa3c-9cbcf2b5243d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df5ede1-1e7c-4108-b732-9081e83128b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4f3b50-79e6-4435-9580-b826e0eff756]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:07:19 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:07:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdb9459-c5fd-4b32-9286-0e3e5548a9d2]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG os_brick.utils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:07:19 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating existing volume attachment record: bba047b0-fdec-41e9-861e-36d70673ab59 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:07:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:07:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ehlIatgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:07:24 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:07:24 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:07:24 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[12474412-41f1-49bc-9e4e-832269ee3142]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:07:24 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09145bd-2172-44a4-8eaa-a481367c6483]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3] added
Apr 11 21:07:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[48295c49-f1c5-4a3f-b4bd-6865c6235dec]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9c2a5-4afd-4315-9f06-f0681bb28342]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ehlIatgB {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ehlIatgB" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a4f8a-ab63-4790-88f3-d84a460f71d8]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ehlIatgB'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd5c9a1-f4d9-41ef-975a-68c36a07deae]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ea19c-6240-412b-8407-549a198e2e2e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e64d637-63b2-4796-b20c-ceff7696c48d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260]
Apr 11 21:07:24 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260] successful.
Apr 11 21:07:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a275fa3-1394-47c7-bdcb-18802db4ecc6]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d675144-e113-422f-a48e-617e669e46d9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:24 user nova-compute[71654]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 (non-flash)
Apr 11 21:07:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:24 user nova-compute[71654]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 (non-flash)
Apr 11 21:07:24 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[699dd2c1-f9d2-4f94-92b3-251e167e19da]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ehlIatgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23335663963663335', 'path': '/dev/sdc'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335663963663335', 'path': '/dev/sdc'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:07:25 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:07:25 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 21:07:25 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:07:25 user nova-compute[71654]:   <serial>31b81ba1-36ae-4686-814c-aca8bc2354d3</serial>
Apr 11 21:07:25 user nova-compute[71654]: </disk>
Apr 11 21:07:25 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No VIF found with MAC fa:16:3e:a9:f3:3f, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:07:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6cfed5e0-de83-4dec-a5a0-734a8c21c4d5 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.240s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:26 user nova-compute[71654]: INFO nova.compute.manager [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Detaching volume 31b81ba1-36ae-4686-814c-aca8bc2354d3
Apr 11 21:07:27 user nova-compute[71654]: INFO nova.virt.block_device [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attempting to driver detach volume 31b81ba1-36ae-4686-814c-aca8bc2354d3 from mountpoint /dev/vdb
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Attempting to detach device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:07:27 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:07:27 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 21:07:27 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:07:27 user nova-compute[71654]:   <serial>31b81ba1-36ae-4686-814c-aca8bc2354d3</serial>
Apr 11 21:07:27 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:07:27 user nova-compute[71654]: </disk>
Apr 11 21:07:27 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:07:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config.
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:07:27 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:07:27 user nova-compute[71654]:   <source dev="/dev/sdc"/>
Apr 11 21:07:27 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:07:27 user nova-compute[71654]:   <serial>31b81ba1-36ae-4686-814c-aca8bc2354d3</serial>
Apr 11 21:07:27 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:07:27 user nova-compute[71654]: </disk>
Apr 11 21:07:27 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681247247.4729981, b5969528-6603-4329-8cc3-8d97e162b8cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:07:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config.
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ehlIatgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:07:27 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ad4ce-ab40-470b-b936-8cd465f36718]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:07:27 user nova-compute[71654]: No targets found.
Apr 11 21:07:27 user nova-compute[71654]: iSNS:
Apr 11 21:07:27 user nova-compute[71654]: No targets found.
Apr 11 21:07:27 user nova-compute[71654]: STATIC:
Apr 11 21:07:27 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3
Apr 11 21:07:27 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:07:27 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:07:27 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d
Apr 11 21:07:27 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:07:27 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:07:27 user nova-compute[71654]: FIRMWARE:
Apr 11 21:07:27 user nova-compute[71654]: No targets found.
Apr 11 21:07:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:07:27 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:07:27 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939d0ae-998f-4df5-b322-513ad92a99f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b5a00-7f3e-40ec-ac19-5b06e93b9090]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:27 user nova-compute[71654]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 (non-flash)
Apr 11 21:07:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:27 user nova-compute[71654]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 (non-flash)
Apr 11 21:07:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb403fb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3'): ({'sdc'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Removing single pathed devices sdc {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01910b7-bd57-4e50-b1ac-5591ad232ea4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4deedc-3d75-4c4a-bdbd-77be8ecd7f44]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flushing IO for device /dev/sdc {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4158bfe1-2499-4526-ad6c-f957f5d95c84]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[76467e2c-49b4-458c-ad2e-2f896b8ed37c]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] SCSI volumes sdc have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e990163-9df4-4276-98a1-38b76ca501d1]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3eae9-1b77-4579-be11-738b2f404c1d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260]
Apr 11 21:07:27 user nova-compute[71654]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3, portal: 172.16.0.220,3260] successful.
Apr 11 21:07:27 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31b81ba1-36ae-4686-814c-aca8bc2354d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc208302-a324-4e70-987e-cfe6a549df06]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== disconnect_volume: return (287ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:07:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:07:28 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:07:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6aee61de-150d-4956-b4cf-00192c7a1dd7 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:07:35 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:35 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:35 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:07:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:41 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:41 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71654) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:07:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8378MB free_disk=26.3121337890625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b5969528-6603-4329-8cc3-8d97e162b8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance ac91ed34-8f95-477d-a951-efa13ccff67b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0a7a0115-1cce-4dab-8207-812e4836a257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:07:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:07:45 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 5a0171d4-fddd-424b-9b11-9f78723f3c1b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [{"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-5a0171d4-fddd-424b-9b11-9f78723f3c1b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:07:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-changed-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Refreshing instance network info cache due to event network-changed-4b20f01b-63c6-48df-ad3e-656d1ba8178d. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Acquiring lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Acquired lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Refreshing network info cache for port 4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:50 user nova-compute[71654]: INFO nova.compute.manager [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Terminating instance
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-vif-unplugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] No waiting events found dispatching network-vif-unplugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.compute.manager [req-2b0027e5-03ad-4289-be54-daa81eecf773 req-e9da4a17-fb1d-49de-bbad-447e51c25cc9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-vif-unplugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updated VIF entry in instance network info cache for port 4b20f01b-63c6-48df-ad3e-656d1ba8178d. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG nova.network.neutron [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updating instance_info_cache with network_info: [{"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:07:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c466e269-a356-4a30-a199-81037383c3c1 req-b83a5b96-bf77-41bf-a388-069ec061a484 service nova] Releasing lock "refresh_cache-ac91ed34-8f95-477d-a951-efa13ccff67b" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:07:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Instance destroyed successfully.
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lazy-loading 'resources' on Instance uuid ac91ed34-8f95-477d-a951-efa13ccff67b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1308181043',display_name='tempest-TestVolumeBootPattern-server-1308181043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1308181043',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDrqhkrym1CfZlb+r+GlNopr6aTwGNF6ss7D41NMi4Nte1p/A4pHRSGMcx1DkMqprm9O4VBj6JyfebwxXg2lgckuEdr334CnYf3AxzSbFaUNZmKliEG84dDSfywNcdtnQ==',key_name='tempest-TestVolumeBootPattern-1519294118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c36c3a15f2a413e81544f65c4f6ede4',ramdisk_id='',reservation_id='r-kxu55h5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-221737316',owner_user_name='tempest-TestVolumeBootPattern-221737316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:06:09Z,user_data=None,user_id='3e34c9542bd64328a3c8d5cdb7421917',uuid=ac91ed34-8f95-477d-a951-efa13ccff67b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converting VIF {"id": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "address": "fa:16:3e:d7:85:01", "network": {"id": "173a3c12-0c1e-4a4c-9682-6e5d62f61daa", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1090828752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c36c3a15f2a413e81544f65c4f6ede4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b20f01b-63", "ovs_interfaceid": "4b20f01b-63c6-48df-ad3e-656d1ba8178d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_vif [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b20f01b-63, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:07:51 user nova-compute[71654]: INFO os_vif [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:85:01,bridge_name='br-int',has_traffic_filtering=True,id=4b20f01b-63c6-48df-ad3e-656d1ba8178d,network=Network(173a3c12-0c1e-4a4c-9682-6e5d62f61daa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b20f01b-63')
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtfiDVJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:07:51 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d533db-c14e-4b67-9fed-f058cf68e02b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:07:51 user nova-compute[71654]: No targets found.
Apr 11 21:07:51 user nova-compute[71654]: iSNS:
Apr 11 21:07:51 user nova-compute[71654]: No targets found.
Apr 11 21:07:51 user nova-compute[71654]: STATIC:
Apr 11 21:07:51 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d
Apr 11 21:07:51 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:07:51 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:07:51 user nova-compute[71654]: FIRMWARE:
Apr 11 21:07:51 user nova-compute[71654]: No targets found.
Apr 11 21:07:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:07:51 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:07:51 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c033006a-36de-48b1-8d0c-09c599b00a0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5ce8c-e0a3-4b4f-9a93-e2a912d47bfc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d (non-flash)
Apr 11 21:07:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb38359fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ddfc6-0be4-4579-8bc2-a5fbf46e89be]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b353023-18e3-4ddb-8ae2-e59f7bf967fc]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52af19e-db20-428d-85e0-2cdc50b8db64]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd2bee-d198-4516-b556-e233c2c56d6c]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4fabc4-86f9-44b6-8c78-32c31c1f2fe0]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f1d7b1-15a2-45fb-9b76-da7ca922a81a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260]
Apr 11 21:07:51 user nova-compute[71654]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d, portal: 172.16.0.220,3260] successful.
Apr 11 21:07:51 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86fa1780-adb9-4e29-b424-0e7bfeee531d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c2c87-aae6-42ab-aef6-2d1f4d654702]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] <== disconnect_volume: return (298ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:07:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Deleting instance files /opt/stack/data/nova/instances/ac91ed34-8f95-477d-a951-efa13ccff67b_del
Apr 11 21:07:51 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Deletion of /opt/stack/data/nova/instances/ac91ed34-8f95-477d-a951-efa13ccff67b_del complete
Apr 11 21:07:51 user nova-compute[71654]: INFO nova.compute.manager [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 21:07:51 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:07:51 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:07:52 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:07:52 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Took 0.65 seconds to deallocate network for instance.
Apr 11 21:07:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:07:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Acquiring lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:52 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] No waiting events found dispatching network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:07:52 user nova-compute[71654]: WARNING nova.compute.manager [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received unexpected event network-vif-plugged-4b20f01b-63c6-48df-ad3e-656d1ba8178d for instance with vm_state active and task_state deleting.
Apr 11 21:07:52 user nova-compute[71654]: DEBUG nova.compute.manager [req-bdfb200b-8064-482b-b0bb-4c4cc6ee4e27 req-03e9a10e-b643-4553-bce9-ac686161b1e9 service nova] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Received event network-vif-deleted-4b20f01b-63c6-48df-ad3e-656d1ba8178d {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:07:53 user nova-compute[71654]: INFO nova.compute.manager [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Took 0.96 seconds to detach 1 volumes for instance.
Apr 11 21:07:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:53 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:07:53 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:07:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:53 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Deleted allocations for instance ac91ed34-8f95-477d-a951-efa13ccff67b
Apr 11 21:07:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-0e7eba18-bf39-444e-8aea-07d00b340556 tempest-TestVolumeBootPattern-221737316 tempest-TestVolumeBootPattern-221737316-project-member] Lock "ac91ed34-8f95-477d-a951-efa13ccff67b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.111s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "0a7a0115-1cce-4dab-8207-812e4836a257" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:59 user nova-compute[71654]: INFO nova.compute.manager [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Terminating instance
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.compute.manager [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-vif-unplugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] No waiting events found dispatching network-vif-unplugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.compute.manager [req-69243354-f5df-40ad-8d30-a4d02c845111 req-fda72452-fb00-4d2b-8841-73ebef5b63ac service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-vif-unplugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:07:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Instance destroyed successfully.
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.objects.instance [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lazy-loading 'resources' on Instance uuid 0a7a0115-1cce-4dab-8207-812e4836a257 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-966792145',display_name='tempest-VolumesActionsTest-instance-966792145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-966792145',id=43,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:06:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be7eb572d88b49979f0c987e7c14e078',ramdisk_id='',reservation_id='r-8lq0x001',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-938970583',owner_user_name='tempest-VolumesActionsTest-938970583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:06:15Z,user_data=None,user_id='1a7549924a014f40a6568d7d771b6957',uuid=0a7a0115-1cce-4dab-8207-812e4836a257,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converting VIF {"id": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "address": "fa:16:3e:06:38:c4", "network": {"id": "ae97f5a1-49e9-43e2-9e75-ef3e505e1027", "bridge": "br-int", "label": "tempest-VolumesActionsTest-648730949-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be7eb572d88b49979f0c987e7c14e078", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1617eac0-ff", "ovs_interfaceid": "1617eac0-ffe9-4e3f-9a40-2c82eaf35578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG os_vif [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1617eac0-ff, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:07:59 user nova-compute[71654]: INFO os_vif [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:38:c4,bridge_name='br-int',has_traffic_filtering=True,id=1617eac0-ffe9-4e3f-9a40-2c82eaf35578,network=Network(ae97f5a1-49e9-43e2-9e75-ef3e505e1027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1617eac0-ff')
Apr 11 21:07:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Deleting instance files /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257_del
Apr 11 21:07:59 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Deletion of /opt/stack/data/nova/instances/0a7a0115-1cce-4dab-8207-812e4836a257_del complete
Apr 11 21:07:59 user nova-compute[71654]: INFO nova.compute.manager [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 11 21:07:59 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:07:59 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:08:00 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:08:00 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Took 0.45 seconds to deallocate network for instance.
Apr 11 21:08:00 user nova-compute[71654]: DEBUG nova.compute.manager [req-17e8b54d-81f9-4e42-9d91-a68d7454e313 req-27e5e326-76a7-4f82-b333-5d688427bfb9 service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-vif-deleted-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:08:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:00 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:08:00 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:08:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:00 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Deleted allocations for instance 0a7a0115-1cce-4dab-8207-812e4836a257
Apr 11 21:08:00 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-57025010-0238-435e-885e-9b33c07a4593 tempest-VolumesActionsTest-938970583 tempest-VolumesActionsTest-938970583-project-member] Lock "0a7a0115-1cce-4dab-8207-812e4836a257" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.535s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received event network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:08:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Acquiring lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:01 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] Lock "0a7a0115-1cce-4dab-8207-812e4836a257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:01 user nova-compute[71654]: DEBUG nova.compute.manager [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] No waiting events found dispatching network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:08:01 user nova-compute[71654]: WARNING nova.compute.manager [req-4278db11-9644-4380-acea-a65b52f1c65b req-31153af5-1709-42b3-b148-dda2a93b498d service nova] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Received unexpected event network-vif-plugged-1617eac0-ffe9-4e3f-9a40-2c82eaf35578 for instance with vm_state deleted and task_state None.
Apr 11 21:08:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:06 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247271.1590521, ac91ed34-8f95-477d-a951-efa13ccff67b => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:08:06 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] VM Stopped (Lifecycle Event)
Apr 11 21:08:06 user nova-compute[71654]: DEBUG nova.compute.manager [None req-f4a127f6-7f5c-4e79-88d4-3924f0473148 None None] [instance: ac91ed34-8f95-477d-a951-efa13ccff67b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:08:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247279.8069181, 0a7a0115-1cce-4dab-8207-812e4836a257 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:08:14 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] VM Stopped (Lifecycle Event)
Apr 11 21:08:14 user nova-compute[71654]: DEBUG nova.compute.manager [None req-07e09e05-69fb-402f-8b8a-8e9903635fc0 None None] [instance: 0a7a0115-1cce-4dab-8207-812e4836a257] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:08:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:18 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:08:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.203s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:19 user nova-compute[71654]: INFO nova.compute.manager [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attaching volume cf6943db-ba5e-49c3-a37d-4fc41648581a to /dev/vdb
Apr 11 21:08:19 user nova-compute[71654]: DEBUG os_brick.utils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15ba12e-efb8-4c6b-95e3-1d3f73eb292c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa248f-a650-4f95-be30-07f61f1ae290]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8f85e6-f53f-4f2b-8e61-9441e177adde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d33b3f9-4af5-4817-b2e0-feb4898b0ab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:08:19 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:08:19 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[85df6c00-8f7c-4152-a16e-e8a2b7b263a6]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG os_brick.utils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating existing volume attachment record: 208e5424-c9f4-421f-968d-64c95505760b {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:08:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZueOst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:08:23 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:08:23 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:08:23 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2636b990-1e9a-4e04-b410-b6bda907be1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:08:23 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737e78a-61bf-4858-bec9-4068d31a2eb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a] added
Apr 11 21:08:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b0cb4-8140-44fa-b13c-c3f91084c7dc]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5ae2bf-cb41-4798-8294-540b1b65e838]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaZueOst {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaZueOst" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e339a782-57a6-47b1-8911-381319a63707]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaZueOst'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aedac9-992b-488b-9c00-223e549547ed]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[233560bd-62c0-48c2-815c-42835c608506]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:08:23 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:08:23 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:08:23 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:08:23 user nova-compute[71654]: 
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce867b36-2663-439e-b4db-cc1829859623]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260]
Apr 11 21:08:23 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260] successful.
Apr 11 21:08:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b191c1be-7aad-4772-9264-0f116e438c9c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab5b5c5-e40c-4909-b61b-5ea69a8990c0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a (non-flash)
Apr 11 21:08:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a (non-flash)
Apr 11 21:08:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d39bc8-7fd8-40d4-865c-dfbf2fdf4399]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:23 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZueOst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23535353761616430', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535353761616430', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:08:24 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:08:24 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:08:24 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:08:24 user nova-compute[71654]:   <serial>cf6943db-ba5e-49c3-a37d-4fc41648581a</serial>
Apr 11 21:08:24 user nova-compute[71654]: </disk>
Apr 11 21:08:24 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:08:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:08:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:08:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No VIF found with MAC fa:16:3e:a9:f3:3f, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:08:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d70a53d2-c4a0-40ad-8eb9-ba35675fc5bb tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.179s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:26 user nova-compute[71654]: INFO nova.compute.manager [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Detaching volume cf6943db-ba5e-49c3-a37d-4fc41648581a
Apr 11 21:08:26 user nova-compute[71654]: INFO nova.virt.block_device [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attempting to driver detach volume cf6943db-ba5e-49c3-a37d-4fc41648581a from mountpoint /dev/vdb
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Attempting to detach device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:08:26 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:08:26 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:08:26 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:08:26 user nova-compute[71654]:   <serial>cf6943db-ba5e-49c3-a37d-4fc41648581a</serial>
Apr 11 21:08:26 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:08:26 user nova-compute[71654]: </disk>
Apr 11 21:08:26 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:08:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config.
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:08:26 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:08:26 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:08:26 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:08:26 user nova-compute[71654]:   <serial>cf6943db-ba5e-49c3-a37d-4fc41648581a</serial>
Apr 11 21:08:26 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:08:26 user nova-compute[71654]: </disk>
Apr 11 21:08:26 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681247306.6966875, b5969528-6603-4329-8cc3-8d97e162b8cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:08:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config.
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaZueOst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:08:26 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac9a475-76c0-47d3-aed5-35b42a56c8ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:08:26 user nova-compute[71654]: No targets found.
Apr 11 21:08:26 user nova-compute[71654]: iSNS:
Apr 11 21:08:26 user nova-compute[71654]: No targets found.
Apr 11 21:08:26 user nova-compute[71654]: STATIC:
Apr 11 21:08:26 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a
Apr 11 21:08:26 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:08:26 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:08:26 user nova-compute[71654]: FIRMWARE:
Apr 11 21:08:26 user nova-compute[71654]: No targets found.
Apr 11 21:08:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:08:26 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:08:26 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51788da-b3b5-4ed5-9cde-f4a0034a792d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a654db84-55fe-4228-9dd9-a5a706db5f6e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a (non-flash)
Apr 11 21:08:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a (non-flash)
Apr 11 21:08:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb2026ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f3878f-da23-4b77-bd9d-82b907fb81e5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069d030-e970-4e50-99ce-cbd6cf7257f9]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d6714e-091e-4a77-b432-cad54220ef1b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4268859a-35ce-4f15-babb-b1ab13002179]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[944fa59d-4ad0-4f0d-a86f-174096911469]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9416d8-9294-443c-b901-59a36b10d3d3]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260]
Apr 11 21:08:26 user nova-compute[71654]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a, portal: 172.16.0.220,3260] successful.
Apr 11 21:08:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6943db-ba5e-49c3-a37d-4fc41648581a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a46820-daa6-4c8f-8a79-66e0703b0ef2]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== disconnect_volume: return (287ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:08:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:08:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:08:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-19d31dfa-e2f0-43d1-bc79-49c17541617b tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.561s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:32 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:32 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:08:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:08:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:08:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:08:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:08:41 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:41 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:08:42 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:08:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:08:43 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8540MB free_disk=26.329025268554688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b5969528-6603-4329-8cc3-8d97e162b8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:08:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:08:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:47 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:08:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:08:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:08:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:09:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:09:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:09:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:09:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:09:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:09:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:18 user nova-compute[71654]: INFO nova.compute.manager [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attaching volume a9115153-339d-4f78-b654-8c13fd359cad to /dev/vdb
Apr 11 21:09:18 user nova-compute[71654]: DEBUG os_brick.utils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a808d-a9c3-4d31-a47e-c79631150c74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d39b7a-0cb6-4429-89c3-6980d1e0aeec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38efdcd-15dd-4992-9894-142eb43c60e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f9080-a440-4d14-b5e0-6f76c8b3d58e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:09:18 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:09:18 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0006472-d383-4770-a243-1eb8fda2b3af]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG os_brick.utils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:09:18 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating existing volume attachment record: 72378129-75c7-46e5-a480-f912bba58511 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:09:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:22 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:09:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STsVvbDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:09:22 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:09:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:09:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:09:22 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:09:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:09:22 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:09:22 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:09:22 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab3d7d7-bd57-451f-9452-7f355d6e3324]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:09:23 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e451a110-d4b8-4d54-923f-05e4b6dad89b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad] added
Apr 11 21:09:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[570793d6-108f-4925-806e-0b4fab961e1b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[3659178d-f684-4a59-85d5-e1e091f1864d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v STsVvbDu {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v STsVvbDu" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22cd60b-a58c-4871-9b03-d1a401af4a50]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'STsVvbDu'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d8164-eae4-48c3-9a4e-8989508ae57d]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee6fc88-1353-4f1d-8ee5-bb4790391f35]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:09:23 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:09:23 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:09:23 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:09:23 user nova-compute[71654]: 
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8d1584-7a19-482a-b570-c553bdac42c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260]
Apr 11 21:09:23 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260] successful.
Apr 11 21:09:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b94fd-3310-4434-bd92-1a2377399121]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[588f51f0-7376-4bdc-ac5f-a0db46b60dab]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad (non-flash)
Apr 11 21:09:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad (non-flash)
Apr 11 21:09:23 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef325ec-239e-48d1-9027-f1065b64857d]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:23 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STsVvbDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23962393531376333', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962393531376333', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:09:24 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:09:24 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:09:24 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:09:24 user nova-compute[71654]:   <serial>a9115153-339d-4f78-b654-8c13fd359cad</serial>
Apr 11 21:09:24 user nova-compute[71654]: </disk>
Apr 11 21:09:24 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] No VIF found with MAC fa:16:3e:a9:f3:3f, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d9f65c15-e627-4fdb-85db-aacd1e1e50d9 tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.600s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:25 user nova-compute[71654]: INFO nova.compute.manager [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Detaching volume a9115153-339d-4f78-b654-8c13fd359cad
Apr 11 21:09:25 user nova-compute[71654]: INFO nova.virt.block_device [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Attempting to driver detach volume a9115153-339d-4f78-b654-8c13fd359cad from mountpoint /dev/vdb
Apr 11 21:09:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Attempting to detach device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:09:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:09:25 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:09:25 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:09:25 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:09:25 user nova-compute[71654]:   <serial>a9115153-339d-4f78-b654-8c13fd359cad</serial>
Apr 11 21:09:25 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:09:25 user nova-compute[71654]: </disk>
Apr 11 21:09:25 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:09:25 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the persistent domain config.
Apr 11 21:09:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:09:25 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:09:25 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:09:25 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:09:25 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:09:25 user nova-compute[71654]:   <serial>a9115153-339d-4f78-b654-8c13fd359cad</serial>
Apr 11 21:09:25 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:09:25 user nova-compute[71654]: </disk>
Apr 11 21:09:25 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681247366.0048647, b5969528-6603-4329-8cc3-8d97e162b8cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:09:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully detached device vdb from instance b5969528-6603-4329-8cc3-8d97e162b8cb from the live domain config.
Apr 11 21:09:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STsVvbDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:09:26 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd32dae-88fb-49d6-916b-785d15f4c49e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:09:26 user nova-compute[71654]: No targets found.
Apr 11 21:09:26 user nova-compute[71654]: iSNS:
Apr 11 21:09:26 user nova-compute[71654]: No targets found.
Apr 11 21:09:26 user nova-compute[71654]: STATIC:
Apr 11 21:09:26 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad
Apr 11 21:09:26 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:09:26 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:09:26 user nova-compute[71654]: FIRMWARE:
Apr 11 21:09:26 user nova-compute[71654]: No targets found.
Apr 11 21:09:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:09:26 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:09:26 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[93326a4c-44da-4886-850a-91c741727ec3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32993da-b4f6-4db4-ba95-0d572c3b67cd]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad (non-flash)
Apr 11 21:09:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad (non-flash)
Apr 11 21:09:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb46efdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a065b1d-276c-4c31-aae7-5d5c5770a73e]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[23611f76-d8de-4844-929e-80b5d7f5f89f]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d18478-b94c-47e3-99b7-ed22d92f8e22]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e3119-3162-45ba-acdf-952ffb272b3b]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c418b3d0-095b-4914-9650-f7e82bbee8b4]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ed9e4-bad2-4aac-86c7-e53164fe6ad2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260]
Apr 11 21:09:26 user nova-compute[71654]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad, portal: 172.16.0.220,3260] successful.
Apr 11 21:09:26 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9115153-339d-4f78-b654-8c13fd359cad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3c333e-0367-4a85-96b4-0825bf0b9612]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] <== disconnect_volume: return (255ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:09:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:09:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'flavor' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:09:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f46a8d02-4a3f-4827-94ac-0e8e30e22b8d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.504s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:28 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:30 user nova-compute[71654]: INFO nova.compute.manager [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Terminating instance
Apr 11 21:09:30 user nova-compute[71654]: DEBUG nova.compute.manager [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:30 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-vif-unplugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] No waiting events found dispatching network-vif-unplugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.compute.manager [req-ad8b5e59-3ee4-49d6-aabd-7cf0ba68111c req-04609825-5cfe-4351-9f39-f112ceda0ebb service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-vif-unplugged-3a08d9a8-9b94-4131-b609-11988264e1a8 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Instance destroyed successfully.
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.objects.instance [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lazy-loading 'resources' on Instance uuid 5a0171d4-fddd-424b-9b11-9f78723f3c1b {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-857833810',display_name='tempest-ServersNegativeTestJSON-server-857833810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-857833810',id=36,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:00:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf42a499ff3c43afaea1b716c0e801ac',ramdisk_id='',reservation_id='r-bulfj4qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1791140415',owner_user_name='tempest-ServersNegativeTestJSON-1791140415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:00:57Z,user_data=None,user_id='8557484fdf27419384420c986b776a90',uuid=5a0171d4-fddd-424b-9b11-9f78723f3c1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converting VIF {"id": "3a08d9a8-9b94-4131-b609-11988264e1a8", "address": "fa:16:3e:d1:a3:ce", "network": {"id": "b786d8af-e6ba-41ff-8577-3472f89d17f0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1306094480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf42a499ff3c43afaea1b716c0e801ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a08d9a8-9b", "ovs_interfaceid": "3a08d9a8-9b94-4131-b609-11988264e1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG os_vif [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a08d9a8-9b, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:31 user nova-compute[71654]: INFO os_vif [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:a3:ce,bridge_name='br-int',has_traffic_filtering=True,id=3a08d9a8-9b94-4131-b609-11988264e1a8,network=Network(b786d8af-e6ba-41ff-8577-3472f89d17f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a08d9a8-9b')
Apr 11 21:09:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Deleting instance files /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b_del
Apr 11 21:09:31 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Deletion of /opt/stack/data/nova/instances/5a0171d4-fddd-424b-9b11-9f78723f3c1b_del complete
Apr 11 21:09:31 user nova-compute[71654]: INFO nova.compute.manager [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 21:09:31 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:09:31 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:09:32 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Took 0.57 seconds to deallocate network for instance.
Apr 11 21:09:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-vif-deleted-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:09:32 user nova-compute[71654]: INFO nova.compute.manager [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Neutron deleted interface 3a08d9a8-9b94-4131-b609-11988264e1a8; detaching it from the instance and deleting it from the info cache
Apr 11 21:09:32 user nova-compute[71654]: DEBUG nova.network.neutron [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG nova.compute.manager [req-9e0250d8-d97f-4c83-9551-f932185bc1f9 req-40e69698-aa55-4901-910b-e0a5315bd8d0 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Detach interface failed, port_id=3a08d9a8-9b94-4131-b609-11988264e1a8, reason: Instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b could not be found. {{(pid=71654) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:32 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Deleted allocations for instance 5a0171d4-fddd-424b-9b11-9f78723f3c1b
Apr 11 21:09:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:32 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-9a97eb78-0f44-4d59-8999-ea32887e35ce tempest-ServersNegativeTestJSON-1791140415 tempest-ServersNegativeTestJSON-1791140415-project-member] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received event network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:09:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Acquiring lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] Lock "5a0171d4-fddd-424b-9b11-9f78723f3c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:33 user nova-compute[71654]: DEBUG nova.compute.manager [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] No waiting events found dispatching network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:09:33 user nova-compute[71654]: WARNING nova.compute.manager [req-6ec3d145-2148-4e49-8268-d72a50281a3a req-0af8d679-0474-4432-a0f4-240381429e65 service nova] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Received unexpected event network-vif-plugged-3a08d9a8-9b94-4131-b609-11988264e1a8 for instance with vm_state deleted and task_state None.
Apr 11 21:09:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:09:35 user nova-compute[71654]: INFO nova.compute.claims [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Claim successful on node user
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:09:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.policy [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:09:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Creating image(s)
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "/opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "/opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.136s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk 1073741824" returned: 0 in 0.058s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "ed9651a25e6d459003445a7bc9db6f25c44fec1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk. size=1073741824 {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Successfully created port: 486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG nova.virt.disk.api [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Cannot resize image /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk to a smaller size. {{(pid=71654) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'migration_context' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Ensure instance console log exists: /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Successfully updated port: 486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-changed-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Refreshing instance network info cache due to event network-changed-486ad182-7f24-417b-9114-3cf40e02c9be. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Instance network_info: |[{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Refreshing network info cache for port 486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Start _get_guest_xml network_info=[{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5eb5099b-ba97-47ac-833b-8ebacdc3051a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:09:37 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:09:37 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=5eb5099b-ba97-47ac-833b-8ebacdc3051a,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3759513651464b9dad082fa5bedbfbfb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T20:31:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1157518724',display_name='tempest-TestStampPattern-server-1157518724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1157518724',id=44,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg==',key_name='tempest-TestStampPattern-438473114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='853a13c27fc0436ab974cfe37f565b75',ramdisk_id='',reservation_id='r-j4w0mjn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-534186208',owner_user_name='tempest-TestStampPattern-534186208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:09:36Z,user_data=None,user_id='1d759f5d03a44e79b24dd72e2b83d4c1',uuid=0e95600e-a2ef-41da-a997-93b6536feb41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converting VIF {"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.objects.instance [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:09:37 user nova-compute[71654]:   <uuid>0e95600e-a2ef-41da-a997-93b6536feb41</uuid>
Apr 11 21:09:37 user nova-compute[71654]:   <name>instance-0000002c</name>
Apr 11 21:09:37 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:09:37 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:09:37 user nova-compute[71654]:   <metadata>
Apr 11 21:09:37 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:09:37 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:09:37 user nova-compute[71654]:       <nova:name>tempest-TestStampPattern-server-1157518724</nova:name>
Apr 11 21:09:37 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:09:37</nova:creationTime>
Apr 11 21:09:37 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:09:37 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:09:37 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:09:37 user nova-compute[71654]:       <nova:owner>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:user uuid="1d759f5d03a44e79b24dd72e2b83d4c1">tempest-TestStampPattern-534186208-project-member</nova:user>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:project uuid="853a13c27fc0436ab974cfe37f565b75">tempest-TestStampPattern-534186208</nova:project>
Apr 11 21:09:37 user nova-compute[71654]:       </nova:owner>
Apr 11 21:09:37 user nova-compute[71654]:       <nova:root type="image" uuid="5eb5099b-ba97-47ac-833b-8ebacdc3051a"/>
Apr 11 21:09:37 user nova-compute[71654]:       <nova:ports>
Apr 11 21:09:37 user nova-compute[71654]:         <nova:port uuid="486ad182-7f24-417b-9114-3cf40e02c9be">
Apr 11 21:09:37 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 21:09:37 user nova-compute[71654]:         </nova:port>
Apr 11 21:09:37 user nova-compute[71654]:       </nova:ports>
Apr 11 21:09:37 user nova-compute[71654]:     </nova:instance>
Apr 11 21:09:37 user nova-compute[71654]:   </metadata>
Apr 11 21:09:37 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:09:37 user nova-compute[71654]:     <system>
Apr 11 21:09:37 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:09:37 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:09:37 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:09:37 user nova-compute[71654]:       <entry name="serial">0e95600e-a2ef-41da-a997-93b6536feb41</entry>
Apr 11 21:09:37 user nova-compute[71654]:       <entry name="uuid">0e95600e-a2ef-41da-a997-93b6536feb41</entry>
Apr 11 21:09:37 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:09:37 user nova-compute[71654]:     </system>
Apr 11 21:09:37 user nova-compute[71654]:   </sysinfo>
Apr 11 21:09:37 user nova-compute[71654]:   <os>
Apr 11 21:09:37 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:09:37 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:09:37 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:09:37 user nova-compute[71654]:   </os>
Apr 11 21:09:37 user nova-compute[71654]:   <features>
Apr 11 21:09:37 user nova-compute[71654]:     <acpi/>
Apr 11 21:09:37 user nova-compute[71654]:     <apic/>
Apr 11 21:09:37 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:09:37 user nova-compute[71654]:   </features>
Apr 11 21:09:37 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:09:37 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:09:37 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:09:37 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:09:37 user nova-compute[71654]:   </clock>
Apr 11 21:09:37 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:09:37 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:09:37 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:09:37 user nova-compute[71654]:   </cpu>
Apr 11 21:09:37 user nova-compute[71654]:   <devices>
Apr 11 21:09:37 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:09:37 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:09:37 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk"/>
Apr 11 21:09:37 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:09:37 user nova-compute[71654]:     </disk>
Apr 11 21:09:37 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:09:37 user nova-compute[71654]:       <mac address="fa:16:3e:61:98:24"/>
Apr 11 21:09:37 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:09:37 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:09:37 user nova-compute[71654]:       <target dev="tap486ad182-7f"/>
Apr 11 21:09:37 user nova-compute[71654]:     </interface>
Apr 11 21:09:37 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:09:37 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/console.log" append="off"/>
Apr 11 21:09:37 user nova-compute[71654]:     </serial>
Apr 11 21:09:37 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:09:37 user nova-compute[71654]:     <video>
Apr 11 21:09:37 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:09:37 user nova-compute[71654]:     </video>
Apr 11 21:09:37 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:09:37 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:09:37 user nova-compute[71654]:     </rng>
Apr 11 21:09:37 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:09:37 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:09:37 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:09:37 user nova-compute[71654]:     </memballoon>
Apr 11 21:09:37 user nova-compute[71654]:   </devices>
Apr 11 21:09:37 user nova-compute[71654]: </domain>
Apr 11 21:09:37 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1157518724',display_name='tempest-TestStampPattern-server-1157518724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1157518724',id=44,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg==',key_name='tempest-TestStampPattern-438473114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='853a13c27fc0436ab974cfe37f565b75',ramdisk_id='',reservation_id='r-j4w0mjn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-534186208',owner_user_name='tempest-TestStampPattern-534186208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:09:36Z,user_data=None,user_id='1d759f5d03a44e79b24dd72e2b83d4c1',uuid=0e95600e-a2ef-41da-a997-93b6536feb41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converting VIF {"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG os_vif [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap486ad182-7f, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap486ad182-7f, col_values=(('external_ids', {'iface-id': '486ad182-7f24-417b-9114-3cf40e02c9be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:98:24', 'vm-uuid': '0e95600e-a2ef-41da-a997-93b6536feb41'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:37 user nova-compute[71654]: INFO os_vif [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f')
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No VIF found with MAC fa:16:3e:61:98:24, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated VIF entry in instance network info cache for port 486ad182-7f24-417b-9114-3cf40e02c9be. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG nova.network.neutron [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a09873c6-d9f8-4792-bb8e-99ee4a9bfabe req-ef53c996-1ba8-47cc-ae8c-fc0680777c84 service nova] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:09:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:38 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG nova.compute.manager [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] No waiting events found dispatching network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:09:39 user nova-compute[71654]: WARNING nova.compute.manager [req-3872a235-8a67-4f81-be8d-074dd5543bc0 req-b5de0cf6-a99f-4473-9cc7-068d2b55da49 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received unexpected event network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be for instance with vm_state building and task_state spawning.
Apr 11 21:09:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] No waiting events found dispatching network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:09:41 user nova-compute[71654]: WARNING nova.compute.manager [req-8da8e9de-a1d8-40bb-99f1-2d787ccb5a2a req-aef094fd-49c6-4fcc-8ec7-32a5c316e71f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received unexpected event network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be for instance with vm_state building and task_state spawning.
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247381.194711, 0e95600e-a2ef-41da-a997-93b6536feb41 => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] VM Resumed (Lifecycle Event)
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Instance spawned successfully.
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Found default for hw_cdrom_bus of ide {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Found default for hw_disk_bus of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Found default for hw_video_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Found default for hw_vif_model of virtio {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247381.1960704, 0e95600e-a2ef-41da-a997-93b6536feb41 => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] VM Started (Lifecycle Event)
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 11 21:09:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:09:41 user nova-compute[71654]: INFO nova.compute.manager [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Took 5.97 seconds to build instance.
Apr 11 21:09:41 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-d507dbd7-d75a-432c-8d0c-4bbc9bbf2b8b tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.064s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:43 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:43 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:43 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:09:44 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:09:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:09:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8538MB free_disk=26.328659057617188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance b5969528-6603-4329-8cc3-8d97e162b8cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:09:45 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:46 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247371.4898987, 5a0171d4-fddd-424b-9b11-9f78723f3c1b => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:09:46 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] VM Stopped (Lifecycle Event)
Apr 11 21:09:46 user nova-compute[71654]: DEBUG nova.compute.manager [None req-12cef0ac-7a2a-41df-bdc1-5250b19fb4b4 None None] [instance: 5a0171d4-fddd-424b-9b11-9f78723f3c1b] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:09:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:48 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:09:48 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:09:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:09:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:09:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:10:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:10:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:10:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:10:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:10:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:10:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:10:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:10:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:10:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:21 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:23 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-changed-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG nova.compute.manager [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Refreshing instance network info cache due to event network-changed-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Acquiring lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Acquired lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Refreshing network info cache for port ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updated VIF entry in instance network info cache for port ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG nova.network.neutron [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [{"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:10:24 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0a93dd9c-0e6b-43ef-b1b8-3b85c9c9d893 req-ec339178-cb48-4185-852a-fd1df61c513c service nova] Releasing lock "refresh_cache-b5969528-6603-4329-8cc3-8d97e162b8cb" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:26 user nova-compute[71654]: INFO nova.compute.manager [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Terminating instance
Apr 11 21:10:26 user nova-compute[71654]: DEBUG nova.compute.manager [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-vif-unplugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] No waiting events found dispatching network-vif-unplugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:10:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-ddec3524-e2c3-4342-afef-561779b7b678 req-22706c1e-fe6a-446e-afb5-6db1c81e170b service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-vif-unplugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:10:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Instance destroyed successfully.
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lazy-loading 'resources' on Instance uuid b5969528-6603-4329-8cc3-8d97e162b8cb {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:04:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1796483703',display_name='tempest-SnapshotDataIntegrityTests-server-1796483703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1796483703',id=41,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXcw4d2/8Jyu4uN3Xyg+X/eTr/DWWnycZDnu/3iBhuvtkr6XoB58mgAQA2Bk3kZzz9pP6hq8KlOXoNwcGwWwN+8S8qZEYZRoUCYs8XACvyH5uN5IV1XGuLn09Beb+3ruQ==',key_name='tempest-SnapshotDataIntegrityTests-1721986425',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:04:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6233baae51b44238a630a75ccea0bdbf',ramdisk_id='',reservation_id='r-azwh83ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-906456256',owner_user_name='tempest-SnapshotDataIntegrityTests-906456256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:04:27Z,user_data=None,user_id='03d8e96524894243b3226f4df3c42376',uuid=b5969528-6603-4329-8cc3-8d97e162b8cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Converting VIF {"id": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "address": "fa:16:3e:a9:f3:3f", "network": {"id": "ec3fa1b2-939c-4388-af73-96cb46915f76", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1718120834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6233baae51b44238a630a75ccea0bdbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce77e6bc-e9", "ovs_interfaceid": "ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG os_vif [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce77e6bc-e9, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:10:27 user nova-compute[71654]: INFO os_vif [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:f3:3f,bridge_name='br-int',has_traffic_filtering=True,id=ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb,network=Network(ec3fa1b2-939c-4388-af73-96cb46915f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce77e6bc-e9')
Apr 11 21:10:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Deleting instance files /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb_del
Apr 11 21:10:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Deletion of /opt/stack/data/nova/instances/b5969528-6603-4329-8cc3-8d97e162b8cb_del complete
Apr 11 21:10:27 user nova-compute[71654]: INFO nova.compute.manager [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 21:10:27 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:10:27 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Took 0.45 seconds to deallocate network for instance.
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-5b4de78a-2080-426e-aae2-48db169d50c7 req-1965c7fd-e720-45d7-8e46-5d75af281e9c service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-vif-deleted-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:27 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:28 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Deleted allocations for instance b5969528-6603-4329-8cc3-8d97e162b8cb
Apr 11 21:10:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-6224d372-a992-4240-ae8b-d121ead1975d tempest-SnapshotDataIntegrityTests-906456256 tempest-SnapshotDataIntegrityTests-906456256-project-member] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.705s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received event network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Acquiring lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] Lock "b5969528-6603-4329-8cc3-8d97e162b8cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:28 user nova-compute[71654]: DEBUG nova.compute.manager [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] No waiting events found dispatching network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:10:28 user nova-compute[71654]: WARNING nova.compute.manager [req-5da4c7c3-79dd-4447-a2f6-0eccb4635e1c req-529a9de8-2fd3-486d-bd4a-672a72e531da service nova] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Received unexpected event network-vif-plugged-ce77e6bc-e9d4-4d8e-9d1d-29f7ad53dfbb for instance with vm_state deleted and task_state None.
Apr 11 21:10:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:34 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:10:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:10:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:42 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247427.2875857, b5969528-6603-4329-8cc3-8d97e162b8cb => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:10:42 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] VM Stopped (Lifecycle Event)
Apr 11 21:10:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-ea0e26a4-623a-4f1c-bc75-9811533ca5af None None] [instance: b5969528-6603-4329-8cc3-8d97e162b8cb] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:10:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:44 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:44 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:10:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:10:45 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=26.318065643310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:10:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:10:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:49 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:50 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:10:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:10:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:10:51 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:10:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:10:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:10:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Verify base images {{(pid=71654) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Image id 5eb5099b-ba97-47ac-833b-8ebacdc3051a yields fingerprint ed9651a25e6d459003445a7bc9db6f25c44fec1d {{(pid=71654) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 21:11:05 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] image 5eb5099b-ba97-47ac-833b-8ebacdc3051a at (/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d): checking
Apr 11 21:11:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] image 5eb5099b-ba97-47ac-833b-8ebacdc3051a at (/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d): image is in use {{(pid=71654) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71654) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] 0e95600e-a2ef-41da-a997-93b6536feb41 is a valid instance name {{(pid=71654) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] 0e95600e-a2ef-41da-a997-93b6536feb41 has a disk file {{(pid=71654) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 21:11:05 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:06 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 is backed by ed9651a25e6d459003445a7bc9db6f25c44fec1d {{(pid=71654) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7
Apr 11 21:11:06 user nova-compute[71654]: WARNING nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Active base files: /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Removable base files: /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609 /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73 /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7 /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3eea1ee5cb86ff1c933288235d77145e522a0d9d
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c76c4b9d982c0137aed8e0d5e5009ca963398d1f
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bfd505b2d93b327add2fad14956572f211308609
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/564a6cb10a479439d07021650f0e4ef66be96f73
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/468329d3dcd7d5dc7b716a475461bf8fe8c7064d
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b73ea97149d66578f17a7ef77f3108c5cf92daca
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d32af19e53ab112b64f17908c20230269467e2d7
Apr 11 21:11:06 user nova-compute[71654]: INFO nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e2e147aefcad7a694daeba1b7ff44596c3c31027
Apr 11 21:11:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Verification complete {{(pid=71654) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 11 21:11:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Verify swap images {{(pid=71654) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 11 21:11:06 user nova-compute[71654]: DEBUG nova.virt.libvirt.imagecache [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Verify ephemeral images {{(pid=71654) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 11 21:11:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:11:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:11:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:11:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-changed-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Refreshing instance network info cache due to event network-changed-486ad182-7f24-417b-9114-3cf40e02c9be. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Refreshing network info cache for port 486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.objects.instance [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'flavor' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:27 user nova-compute[71654]: INFO nova.compute.manager [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Attaching volume 2f3491d9-cd43-418a-9e3a-795034a81016 to /dev/vdb
Apr 11 21:11:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG os_brick.utils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb26ba3-3600-49ee-b3c2-95de0d69a8a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b892c-10cc-4597-82a7-d57e559b92d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6357972-9ddf-4885-9378-d9f78fc47755]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[85003287-870a-45d2-8f4a-d0a21314e311]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated VIF entry in instance network info cache for port 486ad182-7f24-417b-9114-3cf40e02c9be. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:11:27 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2250c3-9653-4ec8-93ca-95075588c68c]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG os_brick.utils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating existing volume attachment record: bf2e8901-b144-4aa9-b102-d198ff0d21ab {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:11:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-0ee63105-a2f5-4294-9682-377c91405a7e req-781ef67b-ab85-47d4-88af-bc30896b132f service nova] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqGKZDyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:11:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:11:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:11:31 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b3fdb-315d-45a4-ade6-cf16c0342380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:11:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f94a3-86be-45af-884e-049a75c376b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016] added
Apr 11 21:11:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e99231-4633-4ca2-9013-22f3565b4705]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cef254-8555-4ffc-a9e6-76b435af7706]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqGKZDyW {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqGKZDyW" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8410901a-8cec-41ed-8f0e-34cc7e65b077]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqGKZDyW'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4587a2bc-9166-46a0-9e27-aeea01a11bde]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6712cc9-6deb-46e8-89b4-a53b82fc6a59]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:11:32 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:11:32 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:11:32 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:11:32 user nova-compute[71654]: 
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7306c7b-d3d0-42bb-bdcf-dc320bd3c373]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260]
Apr 11 21:11:32 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260] successful.
Apr 11 21:11:32 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5147e1-84ee-4fc2-8e05-7f55eb40f834]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362b680-8136-44fb-b84f-b2b5376f1ce6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 (non-flash)
Apr 11 21:11:32 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 (non-flash)
Apr 11 21:11:32 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e508fe3-e85d-49fd-82ab-4ab4e22830e1]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqGKZDyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26336653739633737', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336653739633737', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG nova.objects.instance [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'flavor' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:11:33 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:11:33 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:11:33 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:11:33 user nova-compute[71654]:   <serial>2f3491d9-cd43-418a-9e3a-795034a81016</serial>
Apr 11 21:11:33 user nova-compute[71654]: </disk>
Apr 11 21:11:33 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No VIF found with MAC fa:16:3e:61:98:24, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:11:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-bccdb487-56be-45e7-bedf-09e8b7371270 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.272s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:35 user nova-compute[71654]: INFO nova.compute.manager [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Detaching volume 2f3491d9-cd43-418a-9e3a-795034a81016
Apr 11 21:11:35 user nova-compute[71654]: INFO nova.virt.block_device [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Attempting to driver detach volume 2f3491d9-cd43-418a-9e3a-795034a81016 from mountpoint /dev/vdb
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Attempting to detach device vdb from instance 0e95600e-a2ef-41da-a997-93b6536feb41 from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:11:35 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:11:35 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:11:35 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:11:35 user nova-compute[71654]:   <serial>2f3491d9-cd43-418a-9e3a-795034a81016</serial>
Apr 11 21:11:35 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:11:35 user nova-compute[71654]: </disk>
Apr 11 21:11:35 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:11:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully detached device vdb from instance 0e95600e-a2ef-41da-a997-93b6536feb41 from the persistent domain config.
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e95600e-a2ef-41da-a997-93b6536feb41 from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:11:35 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:11:35 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:11:35 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:11:35 user nova-compute[71654]:   <serial>2f3491d9-cd43-418a-9e3a-795034a81016</serial>
Apr 11 21:11:35 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:11:35 user nova-compute[71654]: </disk>
Apr 11 21:11:35 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681247495.566025, 0e95600e-a2ef-41da-a997-93b6536feb41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:11:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully detached device vdb from instance 0e95600e-a2ef-41da-a997-93b6536feb41 from the live domain config.
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqGKZDyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:11:35 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[560dd7cf-5cb9-40b3-a970-82a103b78ba0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:11:35 user nova-compute[71654]: No targets found.
Apr 11 21:11:35 user nova-compute[71654]: iSNS:
Apr 11 21:11:35 user nova-compute[71654]: No targets found.
Apr 11 21:11:35 user nova-compute[71654]: STATIC:
Apr 11 21:11:35 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016
Apr 11 21:11:35 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:11:35 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:11:35 user nova-compute[71654]: FIRMWARE:
Apr 11 21:11:35 user nova-compute[71654]: No targets found.
Apr 11 21:11:35 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:11:35 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:11:35 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39561e-9ad1-4692-b17b-ba91ac1b09ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e99be81-60c0-4caa-8515-f54ce65e24ef]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 (non-flash)
Apr 11 21:11:35 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 (non-flash)
Apr 11 21:11:35 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb43caa3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34b953a-db8a-4156-846b-bb960b399e82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b946f-5764-4d92-8f71-125c3bb9e8f1]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e4b908-c904-49f4-9bdb-fa5445aea748]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[738ea604-8aa6-405c-803a-4016282c875d]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4d6815-d7ab-4668-a348-0c0193739e5c]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7fe0e2-f4e9-4a9f-bb9e-250be2b090db]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260]
Apr 11 21:11:35 user nova-compute[71654]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016, portal: 172.16.0.220,3260] successful.
Apr 11 21:11:35 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3491d9-cd43-418a-9e3a-795034a81016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c83d2-a9da-4e13-9617-bb26dc13597e]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] <== disconnect_volume: return (279ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:11:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:11:36 user nova-compute[71654]: DEBUG nova.objects.instance [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'flavor' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:11:36 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-f256be5f-6936-42e4-a377-d2153565ff2d tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.643s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:37 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:45 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:45 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:11:46 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:11:46 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:11:46 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=26.316211700439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:11:46 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:11:47 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:50 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 21:11:50 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 21:11:51 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:52 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:11:52 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:52 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:11:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:11:52 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:11:53 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:11:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:11:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:11:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:11:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:11:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:11:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:00 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:00 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Triggering sync for uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:12:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:12:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:12:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:12:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:12:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:22 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:27 user nova-compute[71654]: DEBUG nova.compute.manager [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:12:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:12:27 user nova-compute[71654]: INFO nova.compute.manager [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] instance snapshotting
Apr 11 21:12:27 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Beginning live snapshot process
Apr 11 21:12:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json -f qcow2 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d --force-share --output=json" returned: 0 in 0.133s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdgxabyx0/404ffc9a3cf74e7e911975c6733c3fab.delta 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:28 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed9651a25e6d459003445a7bc9db6f25c44fec1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdgxabyx0/404ffc9a3cf74e7e911975c6733c3fab.delta 1073741824" returned: 0 in 0.054s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:28 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 21:12:28 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:12:29 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71654) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:12:29 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 21:12:29 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:12:29 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdgxabyx0/404ffc9a3cf74e7e911975c6733c3fab.delta /opt/stack/data/nova/instances/snapshots/tmpdgxabyx0/404ffc9a3cf74e7e911975c6733c3fab {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:30 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdgxabyx0/404ffc9a3cf74e7e911975c6733c3fab.delta /opt/stack/data/nova/instances/snapshots/tmpdgxabyx0/404ffc9a3cf74e7e911975c6733c3fab" returned: 0 in 0.692s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:30 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Snapshot extracted, beginning image upload
Apr 11 21:12:32 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Snapshot image upload complete
Apr 11 21:12:32 user nova-compute[71654]: INFO nova.compute.manager [None req-d561712b-a5e2-40f1-a138-9a589352ffb4 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Took 4.89 seconds to snapshot the instance on the hypervisor.
Apr 11 21:12:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Starting instance... {{(pid=71654) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71654) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:12:35 user nova-compute[71654]: INFO nova.compute.claims [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Claim successful on node user
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Start building networks asynchronously for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Allocating IP information in the background. {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] allocate_for_instance() {{(pid=71654) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:12:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Start building block device mappings for instance. {{(pid=71654) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.policy [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d759f5d03a44e79b24dd72e2b83d4c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853a13c27fc0436ab974cfe37f565b75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71654) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Start spawning the instance on the hypervisor. {{(pid=71654) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Creating instance directory {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:12:35 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Creating image(s)
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "/opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "/opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "1c85c5791a8c1e34bc21e0fd957bf15bd4765c82" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "1c85c5791a8c1e34bc21e0fd957bf15bd4765c82" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.part --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.part --force-share --output=json" returned: 0 in 0.144s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG nova.virt.images [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 87ff6c41-d0d1-4d7a-974c-50776e582d4b was qcow2, converting to raw {{(pid=71654) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG nova.privsep.utils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71654) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.part /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.converted {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:36 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Successfully created port: 2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.part /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.converted" returned: 0 in 0.695s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.converted --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "1c85c5791a8c1e34bc21e0fd957bf15bd4765c82" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.787s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82 --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "1c85c5791a8c1e34bc21e0fd957bf15bd4765c82" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "1c85c5791a8c1e34bc21e0fd957bf15bd4765c82" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Successfully updated port: 2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82 --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82,backing_fmt=raw /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk 1073741824 {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-changed-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.compute.manager [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Refreshing instance network info cache due to event network-changed-2111d0ac-22e9-40dd-b069-26b5aeed33f5. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Acquiring lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Acquired lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.network.neutron [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Refreshing network info cache for port 2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82,backing_fmt=raw /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk 1073741824" returned: 0 in 0.061s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "1c85c5791a8c1e34bc21e0fd957bf15bd4765c82" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82 --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.network.neutron [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c85c5791a8c1e34bc21e0fd957bf15bd4765c82 --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:37 user nova-compute[71654]: DEBUG nova.objects.instance [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'migration_context' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Created local disks {{(pid=71654) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Ensure instance console log exists: /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/console.log {{(pid=71654) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.network.neutron [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-46b363ba-d447-4ec5-850c-09949aafcc4b req-18cb1f1f-ee6d-4c63-a930-6b07dfd59809 service nova] Releasing lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquired lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Building network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Instance cache missing network info. {{(pid=71654) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.network.neutron [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating instance_info_cache with network_info: [{"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Releasing lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:12:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Instance network_info: |[{"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71654) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Start _get_guest_xml network_info=[{"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1ee55f1426343a084b92096abeeb013e',container_format='bare',created_at=2023-04-11T21:12:27Z,direct_url=<?>,disk_format='qcow2',id=87ff6c41-d0d1-4d7a-974c-50776e582d4b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-769677008',owner='853a13c27fc0436ab974cfe37f565b75',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T21:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '87ff6c41-d0d1-4d7a-974c-50776e582d4b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:12:39 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:12:39 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71654) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T20:32:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1ee55f1426343a084b92096abeeb013e',container_format='bare',created_at=2023-04-11T21:12:27Z,direct_url=<?>,disk_format='qcow2',id=87ff6c41-d0d1-4d7a-974c-50776e582d4b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-769677008',owner='853a13c27fc0436ab974cfe37f565b75',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T21:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image limits 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flavor pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Image pref 0:0:0 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Got 1 possible topologies {{(pid=71654) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.hardware [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71654) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-667122662',display_name='tempest-TestStampPattern-server-667122662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-667122662',id=45,image_ref='87ff6c41-d0d1-4d7a-974c-50776e582d4b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg==',key_name='tempest-TestStampPattern-438473114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='853a13c27fc0436ab974cfe37f565b75',ramdisk_id='',reservation_id='r-kl4ho99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0e95600e-a2ef-41da-a997-93b6536feb41',image_min_disk='1',image_min_ram='0',image_owner_id='853a13c27fc0436ab974cfe37f565b75',image_owner_project_name='tempest-TestStampPattern-534186208',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-534186208-project-member',image_user_id='1d759f5d03a44e79b24dd72e2b83d4c1',network_allocated='True',owner_project_name='tempest-TestStampPattern-534186208',owner_user_name='tempest-TestStampPattern-534186208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:12:36Z,user_data=None,user_id='1d759f5d03a44e79b24dd72e2b83d4c1',uuid=c7918f9a-aff3-471c-b53d-a076481acb2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71654) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converting VIF {"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.objects.instance [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'pci_devices' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:12:39 user nova-compute[71654]:   <uuid>c7918f9a-aff3-471c-b53d-a076481acb2a</uuid>
Apr 11 21:12:39 user nova-compute[71654]:   <name>instance-0000002d</name>
Apr 11 21:12:39 user nova-compute[71654]:   <memory>131072</memory>
Apr 11 21:12:39 user nova-compute[71654]:   <vcpu>1</vcpu>
Apr 11 21:12:39 user nova-compute[71654]:   <metadata>
Apr 11 21:12:39 user nova-compute[71654]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:12:39 user nova-compute[71654]:       <nova:package version="0.0.0"/>
Apr 11 21:12:39 user nova-compute[71654]:       <nova:name>tempest-TestStampPattern-server-667122662</nova:name>
Apr 11 21:12:39 user nova-compute[71654]:       <nova:creationTime>2023-04-11 21:12:39</nova:creationTime>
Apr 11 21:12:39 user nova-compute[71654]:       <nova:flavor name="m1.nano">
Apr 11 21:12:39 user nova-compute[71654]:         <nova:memory>128</nova:memory>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:disk>1</nova:disk>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:swap>0</nova:swap>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:12:39 user nova-compute[71654]:       </nova:flavor>
Apr 11 21:12:39 user nova-compute[71654]:       <nova:owner>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:user uuid="1d759f5d03a44e79b24dd72e2b83d4c1">tempest-TestStampPattern-534186208-project-member</nova:user>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:project uuid="853a13c27fc0436ab974cfe37f565b75">tempest-TestStampPattern-534186208</nova:project>
Apr 11 21:12:39 user nova-compute[71654]:       </nova:owner>
Apr 11 21:12:39 user nova-compute[71654]:       <nova:root type="image" uuid="87ff6c41-d0d1-4d7a-974c-50776e582d4b"/>
Apr 11 21:12:39 user nova-compute[71654]:       <nova:ports>
Apr 11 21:12:39 user nova-compute[71654]:         <nova:port uuid="2111d0ac-22e9-40dd-b069-26b5aeed33f5">
Apr 11 21:12:39 user nova-compute[71654]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 21:12:39 user nova-compute[71654]:         </nova:port>
Apr 11 21:12:39 user nova-compute[71654]:       </nova:ports>
Apr 11 21:12:39 user nova-compute[71654]:     </nova:instance>
Apr 11 21:12:39 user nova-compute[71654]:   </metadata>
Apr 11 21:12:39 user nova-compute[71654]:   <sysinfo type="smbios">
Apr 11 21:12:39 user nova-compute[71654]:     <system>
Apr 11 21:12:39 user nova-compute[71654]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:12:39 user nova-compute[71654]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:12:39 user nova-compute[71654]:       <entry name="version">0.0.0</entry>
Apr 11 21:12:39 user nova-compute[71654]:       <entry name="serial">c7918f9a-aff3-471c-b53d-a076481acb2a</entry>
Apr 11 21:12:39 user nova-compute[71654]:       <entry name="uuid">c7918f9a-aff3-471c-b53d-a076481acb2a</entry>
Apr 11 21:12:39 user nova-compute[71654]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:12:39 user nova-compute[71654]:     </system>
Apr 11 21:12:39 user nova-compute[71654]:   </sysinfo>
Apr 11 21:12:39 user nova-compute[71654]:   <os>
Apr 11 21:12:39 user nova-compute[71654]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:12:39 user nova-compute[71654]:     <boot dev="hd"/>
Apr 11 21:12:39 user nova-compute[71654]:     <smbios mode="sysinfo"/>
Apr 11 21:12:39 user nova-compute[71654]:   </os>
Apr 11 21:12:39 user nova-compute[71654]:   <features>
Apr 11 21:12:39 user nova-compute[71654]:     <acpi/>
Apr 11 21:12:39 user nova-compute[71654]:     <apic/>
Apr 11 21:12:39 user nova-compute[71654]:     <vmcoreinfo/>
Apr 11 21:12:39 user nova-compute[71654]:   </features>
Apr 11 21:12:39 user nova-compute[71654]:   <clock offset="utc">
Apr 11 21:12:39 user nova-compute[71654]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:12:39 user nova-compute[71654]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:12:39 user nova-compute[71654]:     <timer name="hpet" present="no"/>
Apr 11 21:12:39 user nova-compute[71654]:   </clock>
Apr 11 21:12:39 user nova-compute[71654]:   <cpu mode="custom" match="exact">
Apr 11 21:12:39 user nova-compute[71654]:     <model>Nehalem</model>
Apr 11 21:12:39 user nova-compute[71654]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:12:39 user nova-compute[71654]:   </cpu>
Apr 11 21:12:39 user nova-compute[71654]:   <devices>
Apr 11 21:12:39 user nova-compute[71654]:     <disk type="file" device="disk">
Apr 11 21:12:39 user nova-compute[71654]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:12:39 user nova-compute[71654]:       <source file="/opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk"/>
Apr 11 21:12:39 user nova-compute[71654]:       <target dev="vda" bus="virtio"/>
Apr 11 21:12:39 user nova-compute[71654]:     </disk>
Apr 11 21:12:39 user nova-compute[71654]:     <interface type="ethernet">
Apr 11 21:12:39 user nova-compute[71654]:       <mac address="fa:16:3e:ef:82:b9"/>
Apr 11 21:12:39 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:12:39 user nova-compute[71654]:       <mtu size="1442"/>
Apr 11 21:12:39 user nova-compute[71654]:       <target dev="tap2111d0ac-22"/>
Apr 11 21:12:39 user nova-compute[71654]:     </interface>
Apr 11 21:12:39 user nova-compute[71654]:     <serial type="pty">
Apr 11 21:12:39 user nova-compute[71654]:       <log file="/opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/console.log" append="off"/>
Apr 11 21:12:39 user nova-compute[71654]:     </serial>
Apr 11 21:12:39 user nova-compute[71654]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:12:39 user nova-compute[71654]:     <video>
Apr 11 21:12:39 user nova-compute[71654]:       <model type="virtio"/>
Apr 11 21:12:39 user nova-compute[71654]:     </video>
Apr 11 21:12:39 user nova-compute[71654]:     <rng model="virtio">
Apr 11 21:12:39 user nova-compute[71654]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:12:39 user nova-compute[71654]:     </rng>
Apr 11 21:12:39 user nova-compute[71654]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:12:39 user nova-compute[71654]:     <memballoon model="virtio">
Apr 11 21:12:39 user nova-compute[71654]:       <stats period="10"/>
Apr 11 21:12:39 user nova-compute[71654]:     </memballoon>
Apr 11 21:12:39 user nova-compute[71654]:   </devices>
Apr 11 21:12:39 user nova-compute[71654]: </domain>
Apr 11 21:12:39 user nova-compute[71654]:  {{(pid=71654) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-667122662',display_name='tempest-TestStampPattern-server-667122662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-667122662',id=45,image_ref='87ff6c41-d0d1-4d7a-974c-50776e582d4b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg==',key_name='tempest-TestStampPattern-438473114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='853a13c27fc0436ab974cfe37f565b75',ramdisk_id='',reservation_id='r-kl4ho99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0e95600e-a2ef-41da-a997-93b6536feb41',image_min_disk='1',image_min_ram='0',image_owner_id='853a13c27fc0436ab974cfe37f565b75',image_owner_project_name='tempest-TestStampPattern-534186208',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-534186208-project-member',image_user_id='1d759f5d03a44e79b24dd72e2b83d4c1',network_allocated='True',owner_project_name='tempest-TestStampPattern-534186208',owner_user_name='tempest-TestStampPattern-534186208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:12:36Z,user_data=None,user_id='1d759f5d03a44e79b24dd72e2b83d4c1',uuid=c7918f9a-aff3-471c-b53d-a076481acb2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converting VIF {"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG os_vif [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22') {{(pid=71654) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2111d0ac-22, may_exist=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2111d0ac-22, col_values=(('external_ids', {'iface-id': '2111d0ac-22e9-40dd-b069-26b5aeed33f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:82:b9', 'vm-uuid': 'c7918f9a-aff3-471c-b53d-a076481acb2a'}),)) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:39 user nova-compute[71654]: INFO os_vif [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22')
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No VIF found with MAC fa:16:3e:ef:82:b9, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:12:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:40 user nova-compute[71654]: DEBUG nova.compute.manager [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] No waiting events found dispatching network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:12:40 user nova-compute[71654]: WARNING nova.compute.manager [req-4e8769fb-dbe2-4684-85e3-15adce9eb12e req-70200f6d-00b7-4e38-9c1d-d84165e13f75 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received unexpected event network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance with vm_state building and task_state spawning.
Apr 11 21:12:40 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247562.5930367, c7918f9a-aff3-471c-b53d-a076481acb2a => Resumed> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] VM Resumed (Lifecycle Event)
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Instance event wait completed in 0 seconds for  {{(pid=71654) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Guest created on hypervisor {{(pid=71654) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Instance spawned successfully.
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Found default for hw_input_bus of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Found default for hw_pointer_model of None {{(pid=71654) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.virt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Emitting event <LifecycleEvent: 1681247562.597232, c7918f9a-aff3-471c-b53d-a076481acb2a => Started> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] VM Started (Lifecycle Event)
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71654) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Took 6.97 seconds to spawn the instance on the hypervisor.
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.compute.manager [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG nova.compute.manager [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] No waiting events found dispatching network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:12:42 user nova-compute[71654]: WARNING nova.compute.manager [req-a2733d64-6936-49ba-a0d7-9d8a32542203 req-835c5c4f-e79d-4e67-887f-b3e12c1f9852 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received unexpected event network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance with vm_state building and task_state spawning.
Apr 11 21:12:42 user nova-compute[71654]: INFO nova.compute.manager [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Took 7.50 seconds to build instance.
Apr 11 21:12:42 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-acabf3f5-07dc-4cc3-a3d7-cab4a3821930 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.595s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:46 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:47 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:12:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:12:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:12:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=26.209197998046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance c7918f9a-aff3-471c-b53d-a076481acb2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:12:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:12:50 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:51 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:12:54 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:12:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:12:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:12:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:12:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:12:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:12 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:13:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:38 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:13:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:43 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:13:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:13:47 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:13:47 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:13:48 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:13:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:13:49 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8726MB free_disk=26.20772933959961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance c7918f9a-aff3-471c-b53d-a076481acb2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:13:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:13:50 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:52 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:13:54 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:54 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:13:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:13:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:13:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:13:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:13:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating instance_info_cache with network_info: [{"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:13:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:13:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:13:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:14:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:07 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:14:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:14:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:14:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:14:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-changed-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Refreshing instance network info cache due to event network-changed-2111d0ac-22e9-40dd-b069-26b5aeed33f5. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Acquiring lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Acquired lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG nova.network.neutron [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Refreshing network info cache for port 2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:14:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'flavor' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:14:27 user nova-compute[71654]: INFO nova.compute.manager [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Attaching volume 528bd232-04cf-4816-86aa-5f3f00c2e4aa to /dev/vdb
Apr 11 21:14:27 user nova-compute[71654]: DEBUG os_brick.utils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[405d6f3f-b99e-4c85-8240-6dd5aa210bf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c65ee968b326\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f78d9b-ae97-4635-af95-a3180d1bb8a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb4fd31-4795-4738-ba61-fecdec3af1c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[92af8a3d-fb66-4bce-9ee5-bf4f6f636c9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Running cmd (subprocess): nvme version {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] 'nvme version' failed. Not Retrying. {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] nvme not present on system {{(pid=71654) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:14:27 user nova-compute[71654]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[54caa571-12e0-47ad-a349-7007e4940941]: (4, '') {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71654) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.lightos [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] LIGHTOS: no hostnqn found. {{(pid=71654) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG os_brick.utils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c65ee968b326', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG nova.virt.block_device [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating existing volume attachment record: e88a9fed-f341-4527-a64d-cc884a4a71f9 {{(pid=71654) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updated VIF entry in instance network info cache for port 2111d0ac-22e9-40dd-b069-26b5aeed33f5. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG nova.network.neutron [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating instance_info_cache with network_info: [{"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-f5b1ae14-45a9-44b3-bb7a-7f9150fade31 req-f3dd3ece-d77a-4620-8153-f901f274d998 service nova] Releasing lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:14:27 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Calling os-brick to attach iSCSI Volume {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdhgNrVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:14:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:14:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:14:31 user nova-compute[71654]: INFO os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea89fc-c595-487f-9410-c9b0591f0b64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:14:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --interface default --op new {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e4ac13-d1f4-458e-b47b-dd59f2538a24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa] added\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa] added
Apr 11 21:14:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a813929-8eeb-4f59-9af9-9fac74ccd778]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd421f60-6f9c-402c-baaa-990e471feecf]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdhgNrVA {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdhgNrVA" returned: 0 in 0.021s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fab362-597a-44dd-8a41-2b8149918294]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GdhgNrVA'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[76881375-e782-4b05-a790-749a4df3ecbe]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b4c694-d438-4219-8db2-c049fded1f69]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:14:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:14:31 user nova-compute[71654]:  {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:14:31 user nova-compute[71654]: WARNING os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:14:31 user nova-compute[71654]: 
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --login {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb46655-c1cf-4c69-aaa2-715ff0080547]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260]
Apr 11 21:14:31 user nova-compute[71654]: Login to [iface: default, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260] successful.
Apr 11 21:14:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb5f5a-9687-4be2-8e79-4920779b399b]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a635bb-460b-4e98-a754-0ac367f36424]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa (non-flash)
Apr 11 21:14:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa (non-flash)
Apr 11 21:14:31 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Connected to 172.16.0.220:3260 {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71654) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71654) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baca6d9-47de-47e5-bffd-4419578c3ca8]: (4, ('- - 0', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71654) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:14:31 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdhgNrVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71654) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:14:32 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:14:32 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23935343030666636', 'path': '/dev/sdb'} {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:14:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935343030666636', 'path': '/dev/sdb'} {{(pid=71654) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:14:32 user nova-compute[71654]: DEBUG nova.objects.instance [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'flavor' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:14:32 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:14:32 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:14:32 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:14:32 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:14:32 user nova-compute[71654]:   <serial>528bd232-04cf-4816-86aa-5f3f00c2e4aa</serial>
Apr 11 21:14:32 user nova-compute[71654]: </disk>
Apr 11 21:14:32 user nova-compute[71654]:  {{(pid=71654) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:14:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No BDM found with device name vda, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:14:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71654) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:14:33 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] No VIF found with MAC fa:16:3e:ef:82:b9, not building metadata {{(pid=71654) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:14:33 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-8f41cc14-c087-47ce-b020-0d451f477829 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.087s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:14:34 user nova-compute[71654]: INFO nova.compute.manager [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Detaching volume 528bd232-04cf-4816-86aa-5f3f00c2e4aa
Apr 11 21:14:34 user nova-compute[71654]: INFO nova.virt.block_device [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Attempting to driver detach volume 528bd232-04cf-4816-86aa-5f3f00c2e4aa from mountpoint /dev/vdb
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Attempting to detach device vdb from instance c7918f9a-aff3-471c-b53d-a076481acb2a from the persistent domain config. {{(pid=71654) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:14:34 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:14:34 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:14:34 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:14:34 user nova-compute[71654]:   <serial>528bd232-04cf-4816-86aa-5f3f00c2e4aa</serial>
Apr 11 21:14:34 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:14:34 user nova-compute[71654]: </disk>
Apr 11 21:14:34 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:14:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully detached device vdb from instance c7918f9a-aff3-471c-b53d-a076481acb2a from the persistent domain config.
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7918f9a-aff3-471c-b53d-a076481acb2a from the live domain config. {{(pid=71654) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.guest [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:14:34 user nova-compute[71654]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:14:34 user nova-compute[71654]:   <source dev="/dev/sdb"/>
Apr 11 21:14:34 user nova-compute[71654]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:14:34 user nova-compute[71654]:   <serial>528bd232-04cf-4816-86aa-5f3f00c2e4aa</serial>
Apr 11 21:14:34 user nova-compute[71654]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:14:34 user nova-compute[71654]: </disk>
Apr 11 21:14:34 user nova-compute[71654]:  {{(pid=71654) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-baecddc1-b611-44ec-bfec-d3883b2bb9d7 None None] Received event <DeviceRemovedEvent: 1681247674.8693619, c7918f9a-aff3-471c-b53d-a076481acb2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71654) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.driver [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:14:34 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully detached device vdb from instance c7918f9a-aff3-471c-b53d-a076481acb2a from the live domain config.
Apr 11 21:14:34 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] calling os-brick to detach iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feb4031feb0>, {'target_iqn': 'iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdhgNrVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:14:34 user nova-compute[71654]: WARNING os_brick.initiator.connectors.base [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8c097e-8882-4653-b0bd-0c6f13094dde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:14:34 user nova-compute[71654]: No targets found.
Apr 11 21:14:34 user nova-compute[71654]: iSNS:
Apr 11 21:14:34 user nova-compute[71654]: No targets found.
Apr 11 21:14:34 user nova-compute[71654]: STATIC:
Apr 11 21:14:34 user nova-compute[71654]: Target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa
Apr 11 21:14:34 user nova-compute[71654]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:14:34 user nova-compute[71654]:                 Iface Name: default
Apr 11 21:14:34 user nova-compute[71654]: FIRMWARE:
Apr 11 21:14:34 user nova-compute[71654]: No targets found.
Apr 11 21:14:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:14:34 user nova-compute[71654]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:14:34 user nova-compute[71654]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71654) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa', 0)] {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a27f59a-9d47-47d2-b52c-e6418fa67847]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c0f01-a56f-4b87-9090-c4211ac793b9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa (non-flash)\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa (non-flash)
Apr 11 21:14:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa (non-flash)
Apr 11 21:14:34 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feb38136d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa'): ({'sdb'}, set())}) {{(pid=71654) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Removing single pathed devices sdb {{(pid=71654) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6637e7-8325-4516-b468-ca40a8835b3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b8eb28-8be1-4a2b-95cb-8fbe47981679]: (4, ('ok\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Flushing IO for device /dev/sdb {{(pid=71654) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:14:34 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8179b1-caa6-4f64-9ab5-169e5d402435]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71654) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae599a1d-7f9d-4c92-84fe-35bf1f2a93e6]: (4, ('1', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.linuxscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] SCSI volumes sdb have been removed. {{(pid=71654) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa')] {{(pid=71654) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3e4949-bc02-4dc8-bdf7-7a0922d36501]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --logout {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ae6f0-ea46-4e9c-9399-bdce73e306cf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260]
Apr 11 21:14:35 user nova-compute[71654]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa, portal: 172.16.0.220,3260] successful.
Apr 11 21:14:35 user nova-compute[71654]:  stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op delete {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528bd232-04cf-4816-86aa-5f3f00c2e4aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81862) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce07ba-464a-4e18-9e7c-8da6e5275776]: (4, ('', '')) {{(pid=81862) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71654) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.base [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] <== disconnect_volume: return (284ms) None {{(pid=71654) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Disconnected iSCSI Volume {{(pid=71654) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG nova.objects.instance [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'flavor' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:14:35 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-e4c1370b-8816-4c9e-992f-e56ed71dd8d8 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.607s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:14:37 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:39 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:39 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:14:42 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:42 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:48 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:14:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:14:48 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:14:48 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:14:49 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:14:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:14:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=26.206741333007812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance c7918f9a-aff3-471c-b53d-a076481acb2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:14:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:14:51 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:51 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:54 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:14:54 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Forcefully refreshing network info cache for instance {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG nova.objects.instance [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lazy-loading 'info_cache' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG nova.network.neutron [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated the network info_cache for instance {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:14:55 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:14:57 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:14:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:02 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:15:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:15:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-changed-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Refreshing instance network info cache due to event network-changed-2111d0ac-22e9-40dd-b069-26b5aeed33f5. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Acquiring lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Acquired lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.network.neutron [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Refreshing network info cache for port 2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:25 user nova-compute[71654]: INFO nova.compute.manager [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Terminating instance
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.compute.manager [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-vif-unplugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] No waiting events found dispatching network-vif-unplugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.compute.manager [req-c0a2f8e0-39e1-41a9-85a9-ea1321bbf72d req-39d0eaca-d3da-4e42-9059-b003bee387ee service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-vif-unplugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance with task_state deleting. {{(pid=71654) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.network.neutron [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updated VIF entry in instance network info cache for port 2111d0ac-22e9-40dd-b069-26b5aeed33f5. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG nova.network.neutron [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating instance_info_cache with network_info: [{"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-50ebda73-3708-422d-8348-cac508db6d18 req-a9478299-5c86-4150-9d7d-223d8267a22d service nova] Releasing lock "refresh_cache-c7918f9a-aff3-471c-b53d-a076481acb2a" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:15:25 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Instance destroyed successfully.
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.objects.instance [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'resources' on Instance uuid c7918f9a-aff3-471c-b53d-a076481acb2a {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-667122662',display_name='tempest-TestStampPattern-server-667122662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-667122662',id=45,image_ref='87ff6c41-d0d1-4d7a-974c-50776e582d4b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg==',key_name='tempest-TestStampPattern-438473114',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='853a13c27fc0436ab974cfe37f565b75',ramdisk_id='',reservation_id='r-kl4ho99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0e95600e-a2ef-41da-a997-93b6536feb41',image_min_disk='1',image_min_ram='0',image_owner_id='853a13c27fc0436ab974cfe37f565b75',image_owner_project_name='tempest-TestStampPattern-534186208',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-534186208-project-member',image_user_id='1d759f5d03a44e79b24dd72e2b83d4c1',owner_project_name='tempest-TestStampPattern-534186208',owner_user_name='tempest-TestStampPattern-534186208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:12:43Z,user_data=None,user_id='1d759f5d03a44e79b24dd72e2b83d4c1',uuid=c7918f9a-aff3-471c-b53d-a076481acb2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converting VIF {"id": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "address": "fa:16:3e:ef:82:b9", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2111d0ac-22", "ovs_interfaceid": "2111d0ac-22e9-40dd-b069-26b5aeed33f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG os_vif [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2111d0ac-22, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:15:26 user nova-compute[71654]: INFO os_vif [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=2111d0ac-22e9-40dd-b069-26b5aeed33f5,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2111d0ac-22')
Apr 11 21:15:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Deleting instance files /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a_del
Apr 11 21:15:26 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Deletion of /opt/stack/data/nova/instances/c7918f9a-aff3-471c-b53d-a076481acb2a_del complete
Apr 11 21:15:26 user nova-compute[71654]: INFO nova.compute.manager [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 21:15:26 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:15:26 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Took 0.50 seconds to deallocate network for instance.
Apr 11 21:15:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:26 user nova-compute[71654]: DEBUG nova.compute.manager [req-1254024d-8daf-46fc-bdb4-24b12e3df276 req-91f72006-1aff-4c82-a35f-dced8bf6c1f2 service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-vif-deleted-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:27 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Deleted allocations for instance c7918f9a-aff3-471c-b53d-a076481acb2a
Apr 11 21:15:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-2ebee631-0b08-42e8-baa7-e614a74b74cc tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.715s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received event network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Acquiring lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] Lock "c7918f9a-aff3-471c-b53d-a076481acb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:27 user nova-compute[71654]: DEBUG nova.compute.manager [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] No waiting events found dispatching network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:15:27 user nova-compute[71654]: WARNING nova.compute.manager [req-b93d299f-8f49-404d-9a09-d07ada4d4304 req-d9a9b33f-f764-4352-84e9-0bbe9ed9c4aa service nova] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Received unexpected event network-vif-plugged-2111d0ac-22e9-40dd-b069-26b5aeed33f5 for instance with vm_state deleted and task_state None.
Apr 11 21:15:31 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:36 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:38 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:41 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247726.2592528, c7918f9a-aff3-471c-b53d-a076481acb2a => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:15:41 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] VM Stopped (Lifecycle Event)
Apr 11 21:15:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-06e3b41a-eab1-4208-97f8-36110bded7ec None None] [instance: c7918f9a-aff3-471c-b53d-a076481acb2a] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:15:41 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:41 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:15:43 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:46 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:15:49 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:49 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:49 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:49 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG oslo_concurrency.processutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71654) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:15:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:15:50 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:15:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=26.199153900146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Instance 0e95600e-a2ef-41da-a997-93b6536feb41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71654) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:15:50 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:15:51 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:15:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:15:51 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:15:52 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:54 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:56 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:15:56 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:15:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:15:56 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:15:56 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:01 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:06 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:16 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-changed-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.compute.manager [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Refreshing instance network info cache due to event network-changed-486ad182-7f24-417b-9114-3cf40e02c9be. {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Acquiring lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Acquired lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.network.neutron [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Refreshing network info cache for port 486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:19 user nova-compute[71654]: INFO nova.compute.manager [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Terminating instance
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.compute.manager [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Start destroying the instance on the hypervisor. {{(pid=71654) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.network.neutron [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updated VIF entry in instance network info cache for port 486ad182-7f24-417b-9114-3cf40e02c9be. {{(pid=71654) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.network.neutron [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [{"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-8b2222f5-2a57-4bbf-8c9c-f11ec34d9ce0 req-e7bbb581-869e-4717-8ee7-a36955bf2116 service nova] Releasing lock "refresh_cache-0e95600e-a2ef-41da-a997-93b6536feb41" {{(pid=71654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:16:19 user nova-compute[71654]: INFO nova.virt.libvirt.driver [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Instance destroyed successfully.
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.objects.instance [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lazy-loading 'resources' on Instance uuid 0e95600e-a2ef-41da-a997-93b6536feb41 {{(pid=71654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.virt.libvirt.vif [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1157518724',display_name='tempest-TestStampPattern-server-1157518724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1157518724',id=44,image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZWo7gPdfr3pslpaZFXZ47mIQj+mYM22p5QtsX7LY43KEuweA4q/GUue0PglSlyjneAuB/9aap+d88ogC4xAQPB675oIFrUEYiwPGZVSgCC5yfyczqs5pfWiGuFjUY3vg==',key_name='tempest-TestStampPattern-438473114',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='853a13c27fc0436ab974cfe37f565b75',ramdisk_id='',reservation_id='r-j4w0mjn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5eb5099b-ba97-47ac-833b-8ebacdc3051a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-534186208',owner_user_name='tempest-TestStampPattern-534186208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:12:32Z,user_data=None,user_id='1d759f5d03a44e79b24dd72e2b83d4c1',uuid=0e95600e-a2ef-41da-a997-93b6536feb41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converting VIF {"id": "486ad182-7f24-417b-9114-3cf40e02c9be", "address": "fa:16:3e:61:98:24", "network": {"id": "5bf259c8-6ed5-419a-a20f-bc274f322278", "bridge": "br-int", "label": "tempest-TestStampPattern-1592142055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "853a13c27fc0436ab974cfe37f565b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap486ad182-7f", "ovs_interfaceid": "486ad182-7f24-417b-9114-3cf40e02c9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.network.os_vif_util [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f') {{(pid=71654) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG os_vif [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f') {{(pid=71654) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap486ad182-7f, bridge=br-int, if_exists=True) {{(pid=71654) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:19 user nova-compute[71654]: INFO os_vif [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:98:24,bridge_name='br-int',has_traffic_filtering=True,id=486ad182-7f24-417b-9114-3cf40e02c9be,network=Network(5bf259c8-6ed5-419a-a20f-bc274f322278),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap486ad182-7f')
Apr 11 21:16:19 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Deleting instance files /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41_del
Apr 11 21:16:19 user nova-compute[71654]: INFO nova.virt.libvirt.driver [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Deletion of /opt/stack/data/nova/instances/0e95600e-a2ef-41da-a997-93b6536feb41_del complete
Apr 11 21:16:19 user nova-compute[71654]: INFO nova.compute.manager [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 11 21:16:19 user nova-compute[71654]: DEBUG oslo.service.loopingcall [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71654) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.compute.manager [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Deallocating network for instance {{(pid=71654) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:16:19 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] deallocate_for_instance() {{(pid=71654) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:16:20 user nova-compute[71654]: DEBUG nova.network.neutron [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Updating instance_info_cache with network_info: [] {{(pid=71654) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:16:20 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Took 0.44 seconds to deallocate network for instance.
Apr 11 21:16:20 user nova-compute[71654]: DEBUG nova.compute.manager [req-ffabe8c4-c152-413b-8ab4-de5e73adc799 req-8a84f893-b1a5-4d6a-91cc-93cdc0f220bf service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-vif-deleted-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:16:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:20 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:16:20 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:16:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:20 user nova-compute[71654]: INFO nova.scheduler.client.report [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Deleted allocations for instance 0e95600e-a2ef-41da-a997-93b6536feb41
Apr 11 21:16:20 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-5a1b83a0-80a1-491b-a388-2a29b4f358d9 tempest-TestStampPattern-534186208 tempest-TestStampPattern-534186208-project-member] Lock "0e95600e-a2ef-41da-a997-93b6536feb41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.556s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-vif-unplugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] No waiting events found dispatching network-vif-unplugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:16:21 user nova-compute[71654]: WARNING nova.compute.manager [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received unexpected event network-vif-unplugged-486ad182-7f24-417b-9114-3cf40e02c9be for instance with vm_state deleted and task_state None.
Apr 11 21:16:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received event network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Acquiring lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] Lock "0e95600e-a2ef-41da-a997-93b6536feb41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:21 user nova-compute[71654]: DEBUG nova.compute.manager [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] No waiting events found dispatching network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be {{(pid=71654) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:16:21 user nova-compute[71654]: WARNING nova.compute.manager [req-b38893ea-5586-4979-8e8d-1998c2e4f8cc req-5e75929f-0f3b-45bc-99b8-3b512147521d service nova] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Received unexpected event network-vif-plugged-486ad182-7f24-417b-9114-3cf40e02c9be for instance with vm_state deleted and task_state None.
Apr 11 21:16:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:34 user nova-compute[71654]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681247779.8202727, 0e95600e-a2ef-41da-a997-93b6536feb41 => Stopped> {{(pid=71654) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:16:34 user nova-compute[71654]: INFO nova.compute.manager [-] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] VM Stopped (Lifecycle Event)
Apr 11 21:16:34 user nova-compute[71654]: DEBUG nova.compute.manager [None req-a4374694-2274-4e89-86d8-f8a322a50531 None None] [instance: 0e95600e-a2ef-41da-a997-93b6536feb41] Checking state {{(pid=71654) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:16:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:40 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:41 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:41 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71654) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:16:44 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:16:44 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:45 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:47 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:49 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:50 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:50 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:50 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:50 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Auditing locally available compute resources for user (node: user) {{(pid=71654) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:16:51 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:16:51 user nova-compute[71654]: WARNING nova.virt.libvirt.driver [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=26.290069580078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71654) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71654) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing inventories for resource provider da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating ProviderTree inventory for provider da3f0379-92b3-4d28-8352-8945321a69cc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Updating inventory in ProviderTree for provider da3f0379-92b3-4d28-8352-8945321a69cc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing aggregate associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, aggregates: None {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Refreshing trait associations for resource provider da3f0379-92b3-4d28-8352-8945321a69cc, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=71654) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.compute.provider_tree [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed in ProviderTree for provider: da3f0379-92b3-4d28-8352-8945321a69cc {{(pid=71654) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.scheduler.client.report [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Inventory has not changed for provider da3f0379-92b3-4d28-8352-8945321a69cc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71654) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG nova.compute.resource_tracker [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Compute_service record updated for user:user {{(pid=71654) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:16:51 user nova-compute[71654]: DEBUG oslo_concurrency.lockutils [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:16:53 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:54 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:16:55 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 21:16:55 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] There are 0 instances to clean {{(pid=71654) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 21:16:57 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Starting heal instance info cache {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:16:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Rebuilding the list of instances to heal {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:16:57 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Didn't find any instances for network info cache update. {{(pid=71654) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:16:58 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:16:59 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:04 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:08 user nova-compute[71654]: DEBUG oslo_service.periodic_task [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71654) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:17:08 user nova-compute[71654]: DEBUG nova.compute.manager [None req-668b961f-17ff-4a9c-a9ca-3664195e8266 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71654) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 21:17:09 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:17:11 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:13 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:14 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:17 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:19 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:17:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:17:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:17:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:17:24 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:29 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:17:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:17:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71654) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 21:17:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:17:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71654) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:17:34 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:17:39 user nova-compute[71654]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71654) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}